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USE  OF  SEQUENTIAL  DIFFERENCES 
IN  SMOOTHING  3-D  DATA 


by 

J.  Bryce  Tysver 


Naval  Postgraduate  School 
Monterey,  CA  93940 


May  19  79 


1 .  INTRODUCTION 


In  a  previous  report  (Reference  1) ,  the  author  proposed 
the  use  of  sequential  (successive)  differences  as  an  aid  in 
identifying  outlier  data  points  and  in  selecting  the  appropriate 
order  polynomial  for  smoothing  of  3-D  data  on  torpedo  and  target 
paths.  In  this  report,  the  concept  of  successive  differences 
is  explored  and  developed  with  the  specific  intent  of  making  it 
suitable  for  inclusion  in  a  computer  program  for  smoothing 
3-D  data. 

The  nature  of  the  report  is  in  the  form  of  a  working 
paper  rather  than  a  polished  formal  report.  Some  of  the  dis¬ 
cussions  presented  are  rather  lengthy  and  points  of  interest 
are,  perhaps,  belabored  and/or  repeated  unnecessarily.  The 
reader's  indulgence  is  invited  and  some  skimming  is  expected. 
Nevertheless  the  general  picture  appears  clear  and  the  possi¬ 
bility  of  using  the  model  for  identification  of  outliers 
reasonable . 
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2.  DEVELOPMENT  OF  MODEL 
A.  General  Considerations 

For  the  purposes  of  this  analysis,  it  will  be  assumed 
that  an  observed  datum  x^  can  be  expressed  in  the  form 


x 


i 


x ( t . )  =P  (t.)  +  n.  +  d. 
x  XI  11 


where  P ( t)  is  a  polynomial  in  time  t ,  is  a  measurement 

error  which  will  be  called  "noise,"  and  d^  is  a  perturbation 
or  disturbance  which,  if  present  with  sufficient  amplitude, 

will  cause  x.  to  be  a  "wild"  datum  or  outlier. 

1 

It  will  be  assumed  that  each  component  (x,y,z)  of  a 
torpedo  (T)  or  target  (submarine,  S)  path  can  be  represented 
as  a  polynomial  of  some  low  degree  k  in  time  t.  (It  is 
suggested  that  the  restriction  k  <_  4  be  incorporated  in  the 
smoothing  algorithm.)  Thus 


px(t)  =  a0 


+  a^t 


+  a2t 


+  akfc 


The  noise  component,  n. ,  is  assumed  to  be  a  realization 

of  a  random  variable  which  is  Normally  distributed  with 

2  2 

mean  0  and  common  variance  a  (N^  ~  N(0,a  ))  and  it  is  also 
assumed  that  noise  components  N^  and  N^  at  times  t^  and 
t.  are  independent. 
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Finally,  it  will  be  assumed  that  a  disturbance  d^ 
should  have  fairly  rare  occurrence.  Evidence  of  the  existence 
of  a  non-zero  value  of  d^  can  be  obtained  from  examination 
of  successive  differences  which,  when  sufficiently  high  order 
differences  are  considered,  are  functions  of  the  (n^  +  d^)'s 
and  not  of  the  P(tJ's.  Crossing  of  a  threshold  value  for 
successive  differences,  which  is  seldom  crossed  when  no  d^'s 
are  present,  can  then  be  used  as  an  indication  of  the  presence 
of  a  disturbance  d^  and  hence  of  an  outlier  point.  Note 
that,  not  only  can  noise  only  cause  an  occasional  crossing 
depending  on  the  threshold  selected,  but  the  presence  of  a 
disturbance  may  not  cause  a  threshold  crossing  depending  on 
its  magnitude  and  its  interaction  with  noise.  This  will  be 
elaborated  as  the  development  of  the  model  progresses. 


B .  Successive  Differences 

A  definition  of  successive  or  sequential  differences 
suitable  for  our  purposes  is  presented  in  the  accompanying 
table  (Table  1)  and  the  notation  which  follows .  Since  the 
3-D  data  to  be  smoothed  involves  data  points  equally  spaced 
in  time,  this  has  been  incorporated  in  the  model.  Further, 
the  initial  time  for  any  data  segment  can  be  arbitrarily  set 
to  zero  for  model  development  hence  t^  =  0 .  Also,  selection 
of  the  common  time  interval  as  the  unit  of  time  yields 
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SUCCESSIVE  DIFFERENCES 
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The  selection  of  the  secondary  subscript  i  in  the 
ordered  differences  is  somewhat  arbitrary.  As  will  be  noted  when 
disturbances  are  introduced,  it  appears  desirable  for  computa¬ 
tional  convenience  to  identify  the  even  ordered  differences 
(D_.  and  D. . )  with  the  observation  x.  for  each  i.  For 

example,  a  large  isolated  disturbance  d^  in  x^  will  produce 
large  perturbations  in  D2^  and  hence  the  latter  can 

be  used  to  identify  x^  as  an  'outlier.'  For  the  odd  ordered 
differences  (D^  and  D^)  the  situation  is  not  as  clear. 

For  example,  if  a  large  perturbation  is  observed  in  it 

is  not  clearly  evident  whether  x^  or  should  be  con¬ 

sidered  as  the  'outlier.'  At  this  stage  in  the  development, 
it  would  appear  that  the  even  ordered  successive  differences 
should  be  the  primary  identifiers  of  'outliers.' 


C .  The  Polynomial  Component 

To  illustrate  the  contribution  of  the  polynomial  component 
to  successive  differences,  three  cases  (linear,  quadratic,  and 
cubic)  polynomials  are  presented  in  Tables  2.1,  2.2  and  2.3. 

It  can  readily  be  seen  that  there  is  a  contribution  of  a 
polynomial  of  degree  k  to  D..^  for  j  £  k  but  that  for  j  >  k 
the  number  D..^  represents  noise  only  unless  a  disturbance 
is  present.  Thus  detection  of  a  disturbance,  and  hence  identi¬ 
fication  of  an  outlier,  becomes  simpler  if  a  sufficiently  high 
order  difference  can  be  used  and  the  polynomial  component 
eliminated . 
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TABLE  2.1. 


SUCCESSIVE  DIFFERENCES 


Linear  Case:  x.  =  x(t.)  =  an  +  a.t.  +  n. 

1  1  0  1  i  i 
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I 


TABLE  2.2 

2 

Quadratic  Case:  x^  =  x(t^)  =  a^  +  aiti  +  a2ti  +  ni 

tQ  =  0,  ti+1  =  ti  +  1,  ni  ~  N (0 , a2) 
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The  question  of  how  high  the  order  of  the  difference  must 


be  to  eliminate  the  polynomial  component  is  not  clear-cut.  As 
a  matter  of  fact,  the  polynomial  component  does  not  have  to  be 
eliminated  entirely  for  a  particular  order  of  successive  differ¬ 
ences  to  be  used  to  identify  outliers.  It  is  sufficient  that 
the  contribution  of  the  polynomial  component  P_^  be  small  with 
respect  to  the  noise  component  N_. ^  for  to  be  useful  as 

an  indicator  of  a  disturbance  d.  in  x. . 


1  i 

(This  is  intimately  related  to  the  problem  of  fitting 
polynomials  to  segments  of  a  torpedo  path.  If  (1)  torpedo  path 
does  not  change  too  radically,  (2)  the  length  of  the  path  segment 
to  be  fitted  is  short  enough,  and  (3)  the  data  rate  is  high 
enough,  then  low  order  polynomials  can  provide  satisfactory 
approximations  to  the  path.  In  Reference  1,  path  segments  of 
21  and  11  points  were  explored  briefly.  Path  segments  consisting 
of  7  points  has  been  suggested  but  not  examined  as  yet.  In 
many  of  these  segments  examined  polynomials  of  order  k  <_  3 
produced  acceptably  small  and  apparently  random  residual  errors 
for  11  point  segments.) 

From  Tables  1,  2.1-2. 3  it  can  be  seen  that  a  successive 

difference  D..  of  order  j  involves  j+1  successive  observations 
Di 

x^ .  For  j  <  4,  as  proposed  for  screening  for  outliers,  at  most 
five  data  points  are  involved.  These  can  be  fitted  reasonably 
well  by  polynomials  of  order  k  £  3.  Supporting  evidence  for 
this  is  available  in  the  successive  differences  for  the  3-D 
data  on  the  torpedo  run  examined  in  this  study.  Discussion  of 
the  analysis  justifying  this  contention  will  be  presented  in 


a  later  section. 
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An  alternative  has  been  suggested.  It  incorporates 
control  information  (information  obtained  by  alternate  means  on 
the  command  and  control  of  a  torpedo)  to  provide  appropriate 
values  for  the  polynomial  coefficients  and  to  indicate  appro¬ 
priate  polynomial  order  for  fitting  data.  In  the  linear  case 
this  information  should  be  in  the  form  of  a  specific  value  or 
bound  for  a^ .  Since  a^  =  |V|  cos  9,  as  illustrated  in  the 
accompanying  sketch  with  V  a  velocity  vector  and  |V|  the 
magnitude  of  V,  one  possible  value  for  a^  would  be  a^  £  |V[ . 


This  will  be  shown  to  dominate  the  noise  component  for 

3-D  data.  Information  from  control  data  on  9  could  be  used 

* 


but  would  require  a^  (and  hence  the  threshold  D^)  to  be 
treated  as  a  function  of  position  on  the  torpedo  path  and 
hence  as  a  function  of  t. .  For  the  purpose  of  preliminary 
screening  for  outliers,  it  would  appear  preferable  to  concen¬ 
trate  on  successive  differences  of  sufficiently  high  order 

that  the  polynomial  component  can  be  considered  negligible. 

* 


With  this  constraint,  a  constant  threshold  D.  can  be  used 

3 

for  all  successive  differences  D.^  of  order  j. 
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D .  The  Noise  Component 

When  the  polynomial  component  has  been  eliminated, 

attention  can  be  concentrated  on  the  noise  component  n^  of 

the  jth  order  successive  differences.  In  engineering  parlance, 

the  problem  of  identifying  outliers  can  now  be  considered  as 

one  of  detecting  a  signal  (a  disturbance  d^)  in  the  presence 

* 

of  noise  (n^)  •  The  thresholds  can  be  expressed  as  specified 

levels  of  which  are  seldom  exceeded  by  noise  only  and  hence 

which  indicate  the  presence  of  a  disturbance  d^  .  In  order  to 

* 

establish  values  for  ,  a  statistical  analysis  of  the  noise 
component  is  required. 

Recall  the  assumptions  in  Section  2. A  that  the  noise 

component  n^  is  a  realization  of  a  random  variable  with 

2 

~  N(0,a  )  and  that  and  N_.  are  independent  for  i  ^  j. 

It  can  be  established  from  the  definitions  of  successive  differ¬ 
ences  that  the  noise  component  N..  of  D..  can  be  defined 

ji  31 

in  terms  of  the  noise  components  n^  of  x^  as  follows: 


nli 


n .  -  n .  . 

1  l-l 


n» . 

2i 


n .  , ,  -  2n  .  +  n .  , 

l+l  1  l-l 


n3i 


n .  ,  .  -  3n .  +  3n .  . 
l+l  1  l-l 


ni-2 


n.  • 
4 1 


n. ,,  -  4n. ,,  +  6n . 
1+2  l+l  1 


4n .  .  +  n .  _ 
l-l  1-2 
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Each  of  these  noise  components  have  mean  0  since  the  n^'s 
are  assumed  to  have  mean  0. 


The  variance  V.  of  N..  can  be  expressed  in  terms  of 
D  Di 

2 

the  common  variance  a  of  the  n^ ' s  using  the  independence 
property  of  the  n^'s.  These  are  presented  below  together 
with  some  of  the  covariances  C(n..,k,  )  of  interest  later. 

3-1*  K3T 


S  "fc 

1  Order  Noise  Differences  (N..  . ) 

li 


v±  =  2  a2 

C(nli' 

ni,i+i>  ■  -°2 

2n<^  Order  Noise  Differences  (N2i^ 

v2  =  6a2 

C(i2i, 

i  .  2 

n2, i+1  *  -4a 

C(n2i' 

.  2 
n2, i+2  *  ° 

rd 

2  Order  Noise  Differences  (N^) 


< 

OJ 

II 

20a2 

C(n3i' 

n3, i+l}  “ 

-12a 

C(n3i, 

n3,i+2}  = 

6a 

4^  Order  Noise  Differences  (N  .  .  ) 

4i 


V4 

=  70a2 

C(n4i' 

n4,i+l} 

=  -56a 

C (n41, 

n4,i+2} 

=  28a 
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Selected  Covariances 


c(n2i. 

n3i} 

=  10a 

c(n2i,  n3 

,i+l} 

=  -10a 

c<n2i, 

n4i} 

=  -20a 

C(n3i' 

n4,i> 

=  -35a 

C<n3,i+1' 

n4i) 

=  35a 

Since  all  the  N^'s  are  normally  distributed  with  mean  0, 
it  can  be  established  that 


p(  IN^I  _>  3  /V7)  =  0.997  . 


If  we  set  D.  =  3  /V7  then,  for  applications  in  which  the  poly¬ 
nomial  contributions  to  D..  have  been  eliminated,  there  will 

Di 

be,  on  the  average,  less  than  one  time  in  200  independent  trials 


D  .  . 
3i 


will  exceed  D .  due  to  noise  alone .  The 
3 


in  which  the 

suggested  thresholds  for  detection  of  disturbances  are  given 
below . 


3 

0 

1 

2 

3 

4 

* 

D  . 

3a 

4.24a 

7.348a 

13.416a 

25.10a 

3 

* 

The  term  D . 

3 

with 

j  =  o 

corresponds 

to  v.  =  a2 

1 

(i .e .  , 

the  variance  of  and  hence  of  when  no  polynomial 

is  involved)  . 
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The  suggested  thresholds  are  worth  some  further  exploration 
As  an  oversimplified  case  consider  a  situation  in  which  no  poly¬ 
nomial  contributions  are  involved,  n.  =  3a  for  some  k,  and 

k 


n^  =  0  for  i  ^  k 
* 

Dj ' s  are  shown  in  the  following  table 


The  relationships  of  the  D_.^'s  to  the 


j 

0 

1 

2 

3 

4 

D  =  n 

jk  jk 

3a 

3a 

-6a 

-9a 

18a 

★ 

Dk 

.  .  * 

3a 

4 . 24a 

7.35a 

13.4a 

25  .la 

lnlkl/Dj 

1 

.70  7 

.816 

.6  71 

.717 

Since  ln2k^^2  <3rea't:er  than  the  corresponding  expression 

for  j  =  3  or  j  =  4,  it  could  be  anticipated  that  the  second 
order  differences  (the  D2i's^  might  be  better  detectors  for  dis¬ 
turbances  when  the  polynomial  contribution  is  linear.  This 
will  be  demonstrated  for  an  isolated  disturbance  in  a  later 
section  of  this  report. 

The  type  of  information  to  be  seen  in  the  special  case  of 
an  isolated  noise  element  n^  can  be  generalized.  The  co- 
variances  are  useful  for  this  purpose.  Note  that,  comparing 
the  special  case  to  the  covariances. 
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Special  Case 


°2k  "  -6o 


D2,k+l=  30 


Covariance 


C(n2i'  n3i+l>  =  '4o' 


°2k  =  -6o 


°3k  *  -9o 


C  (n_  .  ,  n_  . )  =  +10a‘l 
2i  3i 


D2k  =  -60 


D.,  =  18a 
4k 


C  (n2i '  n4i)  =  -20a' 


This  relationship  can,  perhaps,  be  made  clearer  by  considering 
the  correlation  coefficients.  For  example. 


C (n~ .  n.  .  )  ..  2 

t  \  -  2i ,  4i  -20a  «  a-,r 

r  (n_  .  ,  n..)  =  - —j—— .  . . —  —  =  -0.976 

Z  4  ^V-V.  /,,  2.  T. 

2  4  %/  ( 6 a  )  (  70a  ) 


The  other  correlation  coefficients  of  interest  here  are 


and 


2i '  n2,i+l) 

—  H 

"  IT  " 

-0.667  , 

r(n2i,  n3i) 

10 

=  0.913  , 

vT2ff 

3i '  n3,i+l} 

-12 

1 

o 

r(n3i,  n4.) 

-35 

-=  -0.9  35 

V1400 

4i'  n4,i+l} 

-56 

00 

o 

1 

15 


I 


These  can  be  interpreted  as  follows.  In  general,  if  has 

a  large  value,  then  n ^  ^ + ^  and  n^  can  be  expected  to  have 
fairly  large  values  of  the  opposite  sign  and  n^  a  fairly 
large  value  of  the  same  sign.  The  importance  of  this  in  detect¬ 
ing  outliers  is  that  the  information  provided  by  different 
orders  of  differences  at  the  same  point  and  by  differences  of 
the  same  order  at  adjacent  points  is  primarily  of  a  confirmation 
nature  rather  than  providing  complementary  information.  This 
can  be  interpreted  to  the  more  practical  statement  that,  for 

example,  if  a  disturbance  in  x^  which  does  not  cause  a  cross- 
★ 

ing  of  by  D^,  then  it  will  usually  not  cause  a  threshold 

crossing  by  D3i'  °4  i-1  or  D4  i+1  ‘  0n  ot^er  hand, 

★ 

if  exceeds  in  magnitude,  then  one  or  more  of  these 

other  differences  has  a  reasonable  chance  of  crossing  its  pre¬ 
scribed  threshold. 

As  a  consequence  of  the  complementary  nature  of  threshold 
crossings  and  of  the  fact  that  is  less  likely  to  be  con¬ 

taminated  by  a  polynomial  component,  it  is  suggested  that  the 
testing  for  outliers  be  performed  by  testing  only  fourth  order 

differences  (the  D^.'s)  f°r  crossing  of  the  appropriate 
* 

threshold  D4 . 

Before  considering  the  disturbance  component  of  x. , 

it  would  be  of  interest  to  consider  the  relative  magnitudes 

of  polynomial  and  noise  components  of  3-D  data.  Of  particular 

★ 

interest  here  is  the  comparison  of  a^  with  D-^  since  these 
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are  the  vital  components  if  the  first  order  differences  are  to  be 
used  for  detecting  outliers.  Since  a,  =  I V I  cos  0,  it  can  be 
seen  that  a^  achieves  its  maximum  magnitude  when  9  =  0J  or 
9  =  18  0°  .  A  plot  of  the  path  of  the  torpedo  in  the  torpedo  run 
selected  for  examination  in  this  study  and  the  corresponding  data 
together  with  the  first  four  orders  of  differences  are  presented 
in  Appendix  A.  It  can  be  seen  that  9=0°  occurs  in  the 

vicinity  of  t  =  950  and  9  =  180°  occurs  in  the  vicinities 

of  t  =  807,  853,  and  917.  An  approximate  value  of  I V |  is 
satisfactory  for  the  present  purposes  and  the  value  |v|  =95 
will  be  used. 

Establishment  of  a  bound  for  the  noise  in  the  form  with 

P(|Nlil  >  3aN1)  <  °-01  ' 

2  2  2 
with  a  =  2a  ,  requires  estimation  of  a  ,  the  noise  variance. 

1 

Reference  1,  estimates  of  a  as  low  as  2  or  3  were  obtained 

for  selected  segments  of  the  torpedo  run  to  be  used  here.  It 

will  be  assumed  for  this  examination  that  a  =  4  and  hence  that 

a„  =  5.656  and  hence  3a„  =  17. 

Ni  Ni 

Boundary  for  D., i  can  then  be  set  in  the  form 

D,  =  +  [  I V |  +  3a^.  ]  =  +_  112. 

i  W1 

Thus,  only  if  D-^  .  were  greater  than  +  112  or  less  than  -112 
would  a  disturbance  be  indicated.  Using  the  formula 

D*  =  | V |  cos  9  +  3aM 
3  -  n ! 


In 
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when  0  is  given  we  have 


A 

* 

'1 

0 

Lower  threshold 

Upper  threshold 

0° 

95  -  17  =  78 

95  +  17  =  112 

90° 

-17 

+  17 

180° 

-95  -  17  =  -112 

-95  +  17  =  -78 

It  can  be  seen  that  detection  of  disturbances  in  the  first  order 
differences  unless  9=0°  or  180°  will  not  be  reliable  when 
a  general  threshold  of  the  form 


is  used. 


* 


+  [ 1 V|  +  3an  ] 


E .  Tlie  Disturbance  Component 

The  presence  of  a  disturbance  or  perturbation  in  an  obser¬ 
vation  x^  can  be  represented  as  an  additional  component  d^ 
so  that 


xi  =  x(ti)  =  P(ti} 


n .  +  d .  . 

l  l 


There  are  several  types  of  perturbations  that  could  be  considered. 
One  of  these,  an  'outlier'  or  isolated  disturbance  d^  that 
occurs  in  only  one  observation  x^,  is  the  simplest.  The  effects 
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of  such  a  disturbance  is  shown  in  Table  3.1  and  the  accompany- 

★ 

ing  sketch.  Figure  3.1.  In  the  sketch  both  d  and  the  D.'s 
are  expressed  in  terms  of  the  parameter  a  (the  standard  deviation 
of  the  noise  component  n^) .  The  value  d  =  5a  is  used  for 
illustrative  purposes.  Also  note  that  the  ordinate  is 


x .  =  x  .  .  -  P  .  .  -n..  =  d  .  . 
ji  31  31  31  31 


and  hence  represents  only  the  disturbance  component  of  x..^. 

There  are  several  features  of  the  successive  differences 

that  should  be  noted  when  an  isolated  perturbation  occurs.  First, 

consider  an  observation  x^  (in  our  example  x^  =  4)  consisting 

of  an  isolated  disturbance  d  =  kcr  without  any  noise  (n^  =  0 

for  all  j  and  i)  and  with  polynomial  component  P(t^)  = a^ +  a^t^ 

* 

The  values  of  k  for  which  the  thresholds  (D_,'s)  are  achieved 
are  shown  below. 


j 

2 

3 

4 

D34 

2ka 

3k  a 

6ka 

* 

D  . 

3 

7.35a 

13.4a 

25.1a 

Critical  k 

3.675 

4.467 

4.183 

In  the  absence  of  the  noise  and  polynomial  components, 
the  second  order  difference  D2^  will  provide  a  threshold  cross¬ 
ing  for  a  smaller  isolated  disturbance  (d  >_  3.675a)  than  either 
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the  third  order  difference  (d  >_  4.4  76a)  or  the  fourth  order 
difference  (d  >_  4.183a)  and  is  slightly  better  than  . 

If  assurances  could  be  given  that  the  polynomial  component  was 
no  higher  than  the  first  degree,  then  the  second  order  differ¬ 
ences  (the  ^2i's^  would  appear  to  provide  the  most  sensitive 
location  to  test  for  isolated  disturbances.  If  polynomial 
components  of  the  second  or  third  degrees  are  possible  then 
the  fourth  order  differences  (the  D^'s)  appear  to  be  prefer¬ 
able  for  testing. 

Next,  consider  the  pattern  or  signature  produced  in  the 

ordered  differences  by  an  isolated  disturbance  at  t  .  Both 

D- .  and  D. .  will  contain  their  maximum  contributions  from 
2i  4i 

the  disturbance  at  D2r  and  (of  opposite  signs)  and  both 

will  have  substantial  but  smaller  contributions  of  opposite 
signs  at  the  adjacent  points  (D2  r_^  and  D2  r+-^  and 

and  r+^)  .  The  third  order  differences  (the  D^’s) 

will  have  contributions  of  equal  magnitudes  but  opposite  signs 
at  adjacent  positions  (D^  r  and  r+]_)  and  smaller  contri¬ 

butions  at  the  next  positions.  Incorporation  of  their  signatures, 
although  clearly  recognizable,  in  the  graph  (see  Fig.  3.1) 
would  be  difficult  to  incorporate  in  a  program  for  automatic 
computer  filtering  of  outliers. 

The  last  item  for  discussion  of  isolated  disturbances 
pertains  to  the  addition  of  noise  and  disturbance  components. 
Consider,  now  a  disturbance  d  =  5a  in  xr  (x^  in  Table  3.1) 
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and  its  effect  on  D^r  in  the  presence  of  noise.  A  positive 

* 

value  of  n4r  will  enhance  crossing  the  threshold  D4  so 
attention  can  be  directed  to  the  effects  of  negative  values 
for  n4r>  If 


n.  <  -(30a  -  25.1a)  =  -4.9a[  4l 
4r  '  /70  a 


=  -.586a 


n 


4i 


* 

then  D4r  will  not  cross  the  upper  threshold  D4  =  25.1a.  For 

this  situation  the  probability  of  a  threshold  crossing  is 
* 

P(N.  >  D.)  =  .721.  In  this  event  n.  .  and  n.  ...  will, 
4n  4  4,r-l  4,r+l 

in  general,  be  positive  since 


r(n„.,  n.  .  .  )  =  r.  (n.  .  ,  n. 

4i  4,i-l  i  4i  4,1+1 


-0.8  (Section  C) 


and  hence  neither  D4  nor  D4  can  be  expected  to  cross 

★ 

the  lower  threshold  D4  =  -  25.1a.  Also,  as  a  consequence  of 

r(n2^,  n4j_)  =  -0.976,  a  negative  value  for  n4r  can  be  expected 

to  be  accompanied  by  a  positive  value  for  n2r  and  hence  D2r 

* 


will  not  cross  the  lower  threshold  D2  =  -7.35a.  Further, 

since  r(n0.,  n0  .  ..)  =  -0.667,  neither  D_  .  nor  D-  ,  , 

2i  2,i+l  2,r-l  2,r+l 

★ 

can  be  expected  to  cross  the  upper  threshold  D2  =  +7. 35a. 

Similarly  the  correlations  r(n.^/  n4^)  =  “0-935  and 

r  (n^,  n^  =  -0.6  make  it  unlikely  that  either  or 

★ 

r+2  will  cross  the  lower  threshold  =  -13.4a  or  the 

* 

upper  threshold  =  +13. 4a,  respectively. 
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TABLE  3.1 


SUCCESSIVE  DIFFERENCES 

Linear  Case:  Isolated  Disturbance  d 
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Thresholds 


FIGURE  3.1 
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The  proposed  use  of  only  one  order  of  successive  differ¬ 
ence  (namely,  D^)  to  test  for  outliers  appears  reasonable  for 

isolated  disturbances.  If  D.  exceeds  its  threshold  then  this 

4r 

will  will  usually  be  accompanied  by  D,  and  D,  exceeding 
their  thresholds  in  the  opposite  direction. 

Attention  can  now  be  directed  to  disturbances  other  than 
isolated  ones.  Consider,  next,  a  situation  involving  distur¬ 
bances  d^  and  d^  in  two  observations.  For  simplicity,  it 
will  be  assumed  that  they  have  the  same  magnitude,  d,  but  can  differ 
in  sign  and/or  location.  The  situation  with  two  adjacent  dis¬ 
turbances  of  the  same  sign  is  presented  in  Table  3.2  and  Figure 
3.2.  Note  that  the  magnitudes  of  the  contributions  of  the 
disturbances  to  D.„  and  D.c  (D.  and  D.  ...  for  equal 
disturbances  in  x  and  x  is  substantially  reduced  from 

that  in  case  of  an  isolated  disturbance  as  is  the  contributions 
to  the  next  adjacent  observations.  It  is  evident  that  large 
adjacent  disturbances  of  the  same  sign  will  be  less  likely  to 
cause  threshold  crossings .  Note  that  a  large  noise  component 
in  one  observation  (n,  ,  for  example)  will,  in  general,  be 
accompanied  by  a  large  noise  component  of  the  opposite  sign 
(r(n^,  n^  =  -0*8)  in  the  other  observation  and  hence 

enhance  the  probability  of  a  threshold  crossing  by  one  of  the 
differences  D^r  or  r+]_  •  In  general,  two  adjacent  large 

values  of  the  same  sign  in  or  D^.  is  a  signature 
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TABLE  3.2 

SUCCESSIVE  DIFFERENCES 


Linear  Case:  Adjacent  Equal  Disturbances 


25 


FIGURE  3.2 
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of  adjacent  disturbances  of  the  same  sign.  (The  possibility 
of  using  reduced  thresholds  for  this  situation  has  not  been 
explored.)  The  magnitudes  of  the  D-^'s  are  also  smaller  than 
in  the  single  disturbance  situation  and  are  separated  by  an 
observation  (D.^)  involving  noise  only. 

Next,  consider  adjacent  disturbances  of  equal  magnitudes 
but  opposite  signs.  This  situation  is  presented  in  Table  3.3 
and  Figure  3.3.  The  additive,  or  magnification,  effect  of  the 
opposing  signs  should  make  even  moderate  magnitudes  of  the 
disturbances  readily  detectable.  The  pattern  or  signature 
should  be  clearly  evident.  It  is  suspected,  however,  that  the 
occurrence  of  this  situation  in  real-life  data  would  be 
extremely  rare  in  comparison  to  the  previous  situation. 

The  situation  in  which  two  disturbances  of  similar 
magnitude  and  sign  separated  by  one  unperturbed  data  point  is 
presented  in  Table  3.4  and  Figure  3.4.  From  the  graph  it  can 
be  seen  that  this  situation  looks  much  like  a  situation  with 
a  single  isolated  disturbance  of  somewhat  greater  magnitude 
and  opposite  sign  (Fig.  3.1) .  This  brings  the  danger  that 
the  observation  x^  (between  the  two  observations  with  dis¬ 
turbances)  could  be  erroneously  labeled  as  an  outlier  and  hence 
removed  and  treated  as  a  missing  point.  In  the  next  section 
missing  points  and  their  replacement  by  the  average  of  the 
observations  on  each  side  of  the  missing  point  will  be  discussed. 
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TABLE  3.3 

SUCCESSIVE  DIFFERENCES 


Linear  Case:  Adjacent  Opposed  Equal  Disturbances 
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50a 


d  =*  5o 


Thresholds 


FIGURE  3.3 
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TABLE  3.4 


SUCCESSIVE  DIFFERENCES 


Linear  Case:  Two  Disturbances  Separated  by  One  Point 
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FIGURE  3.4 

Disturbance  vs  Threshold 
Two  Disturbances  Separated  by  One  Point 

d  =  5a 
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This  treatment  would  introduce  the  disturbance  d  in  the  new 


value  for  and  hence  to  three  adjacent  equal  disturbances. 

The  latter  situations  presented  in  Table  3.5  and  Figure  3.5. 
Note,  first,  that  removal  of  an  observation  and  replacement  of 
the  missing  point  should  be  followed  by  recalculation  of  the 
ordered  differences  affected  and,  second,  that  the  magnitudes 
of  the  contributions  of  the  disturbances  to  the  ordered  differ¬ 
ences  are  substantially  reduced  from  the  contributions  in  either 
the  isolated  disturbance  situation  or  the  separated  distur¬ 
bances  situation.  In  this  modified  situation  the  reduced 
thresholds  presented  in  the  next  section  will  improve  the 
capability  of  indicating  the  presence  of  the  two  separated 
disturbances.  A  threshold  crossing  by  any  of  the  D^^'s  with 
i  =  3,  4,  5,  6  in  the  modified  results  should  serve  as  an 
indicator  that  disturbances  may  be  present  in  x^  and  x^ 
rather  than  in  x^ . 

In  addition  to  the  occurrence  of  three  adjacent  and 
equal  disturbances  in  the  treatment  of  two  such  disturbances 
by  replacing  missing  points,  it  is  possible  that  this  situation 
can  occur  due  to  the  persistence  of  the  perturbation  causing 
the  disturbances .  The  lower  disturbance  contributions  to  the 
ordered  differences  could  readily  fail  to  produce  a  threshold 
crossing  as  could  the  situation  with  two  adjacent  equal  dis¬ 
turbances  whereas  the  situation  with  an  isolated  disturbance 
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TABLE  3.5 


SUCCESSIVE  DIFFERENCES 


Linear  Case:  Three  Adjacent  Equal  Disturbances 
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D* 


°3 


°2 


t  . 
1 


-D* 


FIGURE  3.5 
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of  the  same  magnitude  would  yield  a  threshold  crossing.  These 
situations  with  more  than  one  adjacent,  equal  disturbances  may 
require  greater  consideration  of  the  signatures  identifying 
them.  (See  Figures  3.2  and  3.5.)  Such  modifications  are  not 
examined  further  in  this  report. 

For  the  present,  it  will  be  assumed  that  successive 
differences  will  be  incorporated  in  a  data  smoothing  algorithm 
for  the  two  purposes  discussed  in  the  introduction  (Section  I) , 
namely,  identifying  outliers  and  indicating  appropriate  order 
polynomials  for  fitting  the  data.  There  are  two  ways  that 
sequential  differences  can  be  used  in  identifying  outliers. 

One  is  as  a  preliminary  screening  to  remove  some  of  the  more 
obvious  outliers  to  be  followed  by  a  reexamination  for  outliers 
in  the  curve  fitting  portion  of  the  data  smoothing  algorithm 
as  presently  incorporated  in  the  general  track  smoothing  program 
MASM3DRJ.  The  other  approach  would  require  sequential  differ¬ 
ences  to  provide  the  only  means  of  identifying  outliers.  As 
indicated  by  the  comparatively  simple  situations  considered 
here,  this  would  require  considerably  more  modal  development 
and  become  a  considerably  large  portion  of  a  data  smoothing 
program.  For  the  purposes  of  this  report,  the  first  approach 
will  be  considered  appropriate. 

A  situation  with  two  equal  disturbances  separated  by 
two  unperturbed  observations  is  presented  in  Table  3.6  and 
Figure  3.6.  It  should  be  observed  that  when  disturbances  are 
separated  by  as  few  as  two  points  they  can  be  considered  essen¬ 
tially  as  isolated  disturbances.  (See  Table  3.1  and  Figure  3.1.) 
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TABLE  3.6 


SUCCESSIVE  DIFFERENCES 

Linear  Case:  Two  Equal  Disturbances  Separated  by  Two  Points 
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Thresholds 


FIGURE  3.6 
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There  are  other  types  of  perturbations  that  could,  and 
possibly  should,  be  considered  for  potential  identification  by 
successive  differences.  Only  one  of  these  will  be  examined  here. 
This  is  the  situation  in  which  the  torpedo  changes  from  a 
linear  path  at  t  to  a  different  linear  path  at  t  This 

situation  is  presented  in  Table  3.7  and  Figure  3.7.  As  can  be 
seen  by  comparison  of  Table  3.7  with  Table  3.1,  it  is  possible 
that  a  path  change  at  t  =  r  could  lead  to  the  identification 
of  as  containing  a  disturbance  d  depending  on  the  magnitude 

of  A^  and  d.  The  resemblance  of  the  signature  (graph)  of 
in  the  two  situations  could  be  even  more  striking  for  a 
value  of  d  such  that  2  °f  Table  3.1  (corresponding  to 

r_2  of  Table  3.7)  were  small  enough  to  be  submerged  in  noise 
and  A^  =  3d.  That  a  path  change  could  conceivably  cause  a 
threshold  crossing  of  D*  by  can  be  seen  in  the  case  of 

a  90°  change  from  8=0  to  0'  =  90°  (or,  vice  versa)  where 
I  A^|  =  | V |  =90.  The  situation  is  even  worse  for  a  90° 
change  from  6  =  45°  to  0'  =  135°  with  lAj  =  1.4(90)  =  126. 

Possible  methods  of  identifying  path  changes  to  prevent 
mis-identification  as  outliers  include  reconsideration  of 
labeled  outliers  after  fitting  curves  to  the  data  and  provision 
from  an  external  source  such  as  control  information.  The  first 
method  requires  greater  complication  of  the  data  smoothing 
program  involving  cycling  and  hence  negates  the  intent  of  a 
simple  screening  program  for  outliers .  The  second  requires 
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TABLE  3.7 


Linear  Case:  Path  Change  at  t^  =  r 
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FIGURE  3.7 
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input  information  from  another  source  and  is  also  undesirable 
but  to  a  lesser  extent.  An  alternative  treatment  is  to  accept 
such  identification  of  point  of  path  change  as  providing  an 
outlier  to  be  removed  from  the  data.  The  consequences  of  this 
treatment  will  be  examined  in  a  subsequent  report  on  curve  fitting 
and  appears,  at  least  for  the  present,  to  be  a  reasonable  way 
of  handling  the  situation. 

There  is  still  another  kind  of  perturbation  which  can, 
and  has  been  observed  to  occur.  This  is  a  change  in  the  noise 
component  and  represented  by  a  change  in  the  value  of  the 
standard  deviation  o  .  Such  changes  may  be  a  result  of  changes 
in  the  environment  or  of  the  data  gathering  system.  Evidence 
of  such  changes  in  the  value  of  a  should  be  accommodated  by 
corresponding  changes  in  the  threshold  levels. 


F.  Missing  Points 

The  occurrence  of  missing  observations  in  a  sequence 
of  observations  needs  some  consideration.  A  missing  observation 
can  be  present  in  the  data  input  or  occur  as  a  result  of  deletion 
of  an  outlier.  Note  that,  in  the  latter  case,  recalculation  of 
successive  differences  will  be  required  in  the  vicinity  of 
the  deleted  observation. 

As  the  simplest  procedure  for  replacing  missing  points, 
the  currently  used  procedure  of  averaging  over  the  adjacent 
points  will  be  used  here.  (This  also  will  be  re-examined  when 
curve-fitting  is  discussed.)  Thus,  when  xr  is  missing  it 
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it  will  be  replaced  by 


=  =■  (x 


r-1 


+  x 


r+l; 


and  when  adjacent  values  x  and  xr+]_  are  missing  they  will 
be  replaced  by 
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r+k  r-1  J 


is 

k-1  . 


There  is  a  serious  question,  however,  if  an  analysis  of 
successive  differences  is  improved  by  replacement  of  more  than 
two  successive  missing  values.  It  would  appear  more  reasonable, 
at  least  on  examination  of  the  fourth  order  successive  differ¬ 
ences  which  involve  only  sequences  of  five  observations,  to 
restart  calculation  of  successive  differences  at  the  first 
observation  after  a  sequence  of  more  than  two  missing  observations. 

The  situation  involving  a  missing  point  with  linear 
polynomial  and  noise  components  only  is  presented  in  Tables  4.1 
and  the  accompanying  definitions  for  the  modified  noise 
components  with  their  variances.  Reduced  thresholds  could 
be  used  as  indicated  in  Table  4.2  and  Figure  4.1.  These  reduced 
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TABLE  4.1 


Linear  Case:  Missing  Point  (x^)  Averaged 
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TABLE  4.1  Continued 
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TABLE  4.2 


Linear  Case:  Detection  Thresholds  for  Missing  Point  Datum  at 

D* .  =  3a  ,  Table  Values  for  3a  .  .  /a 
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FIGURE  4.1 

Thresholds  in  Vicinity  of  a  Missing  Point 
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thresholds  could  be  useful  in  identifying  situations  involving 

equal  disturbances  separated  by  one  observation  where  that 

observation  is  labeled  as  an  outlier  and  replaced  by  the 

average  of  the  two  observations  with  disturbances.  Recalculation 

of  the  fourth  order  differences  produces  the  disturbance 

components  given  in  the  last  column  of  Table  3.5  which  are 

shown  with  the  modified  thresholds  in  Figure  4.2.  (This 

situation  is  the  same  as  for  two  disturbances  separated  by  a 

missing  point.)  Persistence  of  a  threshold  crossing  at  t 

after  deletion  and  replacement  of  the  observation  can 

be  an  indication  that  disturbances  may  be  present  in 

and  xr+i  instead  of,  or  in  addition  to,  a  disturbance 

in  x  . 
r 

Some  additional  work  is  required  here  to  assist  in 
developing  that  portion  of  the  data  smoothing  program  dealing 
with  successive  differences.  It  is  fairly  clear  that  the 
existence  of  a  threshold  crossing  requires  more  effort  to 
determine  whether  it  indicates  an  isolated  outlier  or  a  more 
complicated  situation.  A  situation  with  two  adjacent  missing 
observations  and  no  disturbances  is  displayed  in  Table  4.3 
accompanied  by  the  expressions  for  the  noise  components  in 
terms  of  the  observational  noise.  The  variances  for  the  noise 
components  presented  there  provide  the  basis  for  the  thresholds 
shown  in  Table  4.4.  The  thresholds  for  the  isolated  missing 
point  situation  are  also  shown  in  Table  4.4.  Note  that  the 
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FIGURE  4.2 

Two  Disturbances  Separated  by  a  Missing  Point  Averaged 
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TABLE  4.3 


Linear  Case:  Adjacent  Missing  Points  Averaged 
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TABLE  4 . 3  Continued 
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TABLE  4.4 


THRESHOLDS  FOR  NOISE  IN  ONE  AND  TWO  MISSING  POINT  SITUATIONS 
k  such  that  D*.  =  3ct  =  ka 

I!  n.i 
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thresholds  in  the  two  missing  points  situation  are  smaller 
than  the  corresponding  ones  in  a  situation  with  a  single 
missing  point. 

A  situation  in  which  a  disturbance  occurs  in  an  obser¬ 
vation  adjacent  to  a  missing  point  is  presented  in  Table  4.5 
(It  is  suspected  that  in  situations  involving  one  or  more  miss¬ 
ing  points,  could  also  involve  disturbances  immediately  preceding 
of  following  a  missing  point  due  to  deteriorization  of  physical 
conditions.)  The  disturbance  components  are  shown  in  relation¬ 
ship  to  the  common  thresholds  appropriate  when  there  are  no 
missing  points  in  Figure  4.3  and  to  the  reduced  thresholds  in 
Figures  4.4,  4.5  and  4.6.  It  can  be  seen  that  the  use  of  the 
modified  thresholds  can  increase  the  potential  crossing  of 
thresholds  in  the  vicinity  of  a  missing  point  substantially. 

Examination  of  the  effects  of  missing  points  on  the 
ability  of  successive  differences  to  indicate  the  presence  of 
disturbances  is  not  complete.  For  example,  situations  with 
disturbances  preceding  and/or  following  adjacent  missing 
points  have  not  been  examined.  Nevertheless,  some  indications 
of  the  consideration  of  missing  points  in  the  use  of  successive 
differences  to  screen  3-D  data  for  outliers  can  be  suggested 
at  this  point  in  the  development.  Under  the  guiding  principle 
of  keeping  the  data  smoothing  program  as  short  and  simple  as 
possible,  and  with  the  understanding  that  a  further  screening 
for  outliers  could  be  included  in  the  curve  fitting  portion  of 
the  program,  the  following  steps  appear  reasonable: 
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TABLE  4 . 5 


Linear  Case:  Disturbance  Following  Missing  Point 


(For  n*. 's  see  Missing  Point  Table,  Table  4.1.) 
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FIGURE  4 . 3 
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Linear  Case:  Second  Order  Differences  vs  Thresholds 
Disturbance  Following  Missing  Point. 


Linear  Case:  Third  Order  Differences  vs  Thresholds 
Disturbance  Following  Missing  Point 


x' 

3i 


Linear  Case: 


Fourth  Order  Differences  vs  Thresholds 
Disturbance  Following  Missing  Point 


FIGURE  4.6 
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(1)  Supply  missing  points  using  the  averaging  method. 

(2)  Screen  for  outliers  using  the  fourth  order  differences 

D>  .  and  the  common  threshold  DJ. 

4i  4 

(3)  Replace  any  outliers  found  by  the  averaging  method. 

(4)  Screen  for  outliers  in  the  vicinity  of  any  values 
replaced  in  Step  3  (not  those  in  Step  1)  using  the 
reduced  thresholds  D|^  for  the  D^'s. 

(5)  Any  outliers  found  in  Step  4  should  be  referred  for  manual 
examination,  at  least  until  further  development  can  provide 
satisfactory  provisions  for  inclusion  in  the  smoothing 
program. 


G .  Noise  Variance 

In  Section  2.D,  it  was  assumed  that  the  noise  components 

of  the  data  were  normally  and  independently  distributed  with 

.  2 

zero  means  and  common  variance  a  .  This  variance,  or  more 
specifically  the  standard  deviation  a,  must  be  known  before 
the  thresholds  discussed  in  Sections  2.D,  E,  and  F  can  be 
specified.  Selection  of  an  appropriate  value  for  a  requires 
more  detailed  examination.  Three  potential  sources  of  values 
for  a  will  be  considered  here. 

In  Reference  1,  which  incidentally  used  path  segments 
from  the  same  set  of  data  to  be  used  in  this  study,  sample 
standard  deviations  of  magnitudes  Sx  =  2  or  3  were  calculated 
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for  some  path  segments.  Sample  standard  deviations  provide 
the  primary  sources  of  information  on  the  value  of  a  and  hence 
are  of  considerable  interest  in  setting  threshold  values.  They 
can  be,  unfortunately,  contaminated  by  the  polynomial  components 
in  the  observations  as  was  demonstrated  in  the  reference. 
Nevertheless,  a  value  of  the  order  of  a  =  3  or  a  =  4  is 
an  approximation  which  could  be  used  in  setting  thresholds  for 
screening  for  outliers.  Experience  with  larger  samples  including 
other  runs  will  provide  a  more  reasonable  basis  for  estimating  a. 

It  is  to  be  expected  that  there  will  be  spatial  and 
temporal  variations  in  a.  Spatial  variables  can  be  present 
because  of  the  geometry  of  the  vehicle-sensor  orientation.  Data 
from  which  the  value  of  a  and  its  spatial  variations  should 
be  available  from  previous  and  continuing  calibration  data 
collected  on  the  position  location  system.  Information  on  temporal 
variations  should  be  available  from  the  same  source  and  should 
also  be  monitored  during  the  collection  of  any  data  for  which 
data  smoothing  is  to  be  performed.  It  should  also  be  expected 
that  there  will  be  interaction  between  spatial  and  temporal 
variation  in  a,  i.e.,  that  the  temporal  variation  can  be 
different  for  different  locations  on  the  path  of  the  vehicle 
being  tracked.  This  would  imply  that  the  thresholds  to  be  used 
for  indicating  outliers  may,  and  probably  should,  be  changed 
depending  on  the  location  and  time  of  the  data  to  be  smoothed. 
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The  third  potential  source  for  information  on  a  is 
the  data  to  be  smoothed.  A  single  estimate  S  for  a  =  a 
may  be  calculated  from  the  complete  set  of  data  or  estimates 
may  be  calculated  for  segments  of  the  data.  These  can  be 
expected  to  be  contaminated  by  both  the  polynomial  and  pertur¬ 
bation  components  in  the  data.  Reduction  in  the  polynomial 
component  contribution  could  be  obtained  by  using  successive 
differences  as  the  source  of  the  estimates.  Thus,  for  example, 
the  sample  variance  of  the  fourth  order  differences 
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This  should  have  little  or  no  contamination  from  the  poly 
nomial  components  of  the  observations.  If  the  outliers  are 
reasonably  rare,  the  perturbation  contributions  should  also 
be  small  and  the  resulting  estimate  could  be  a  reasonable 
alternative.  Note  that  estimates  of  a  could  be  obtained  for 
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segments  of  the  data  and  hence  could  be  made  to  respond  to  the 
spatial  and  temporal  variations  in  a  discussed  in  the  second 
alternative . 

This  third  method  of  estimating  a  has  a  direct 
relationship  to  the  method  (Grubb's)  incorporated  in  the 
currently  used  program  for  identifying  outliers.  In  fact,  a 
Grubb's  type  of  screening  could  be  performed  with  the  sample 
variances  of  successive  differences  where  an  observation  is 
labeled  an  outlier  if  its  removal  provides  a  substantial 
reduction  in  the  sample  variance.  This  possibility  has  not 
been  explored. 


H .  Algorithm  for  Identifying  Outliers 

The  following  algorithm  is  suggested  for  identifying 
and  removal  of  gross  outliers.  Two  basic  principles  are 
considered  essential: 

(1)  The  algorithm  should  be  simple  and  short. 

(2)  A  subsequent  and  more  thorough  search  for  outliers  will 
be  incorporated  in  the  data  smoothing  program  concurrent 
with  or  following  the  curve-fitting  portion  of  the  program. 

The  steps  of  the  algorithm  are : 

I.  Calculate  values  for  missing  points  using  the  method 
of  averaging. 

2.  Calculate  the  fourth  order  differences  D4 . . 
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3.  Identify  as  outliers  and  remove  from  the  data  any  x^  for 
which  l°4]Cl  >  25.1a.  (The  suggested  value  of  a  to  be 
used  here  is  a  number  between  3  and  4.) 

4.  Replace  any  identified  as  an  outlier  in  Step  3  using 

the  averaging  method  as  in  Step  1. 

5.  Recalculate  the  fourth  order  differences  which  involve  x^ . 

(These  are  D4,k_2,  *••  •  D4,k+2*^ 

6.  Re-examine  the  modified  fourth  order  differences  of  Step  5 
for  outliers  as  in  Step  3. 

7.  If  additional  outliers  are  found  in  Step  6,  either 
additional  steps  must  be  designed  to  locate  potential 
outliers  in  the  vicinity  of  the  observation  x^  (from 
Step  3)  or  the  problem  must  be  identified  for  manual 
treatment. 

I .  Identifying  Polynomial  Components 

In  using  successive  differences  to  indicate  the  appropriate 
degree  of  the  polynomial  component  P(t),  attention  is  directed 
to  the  sequence  of  signs  of  the  differences  of  the  same  order. 
The  reasoning  for  this  is  as  follows.  In  Section  2  .D  it 
was  established  that  the  noise  component  n  of  the  i^ 

ji 

difference  of  order  j  is  a  linear  combination  of  the  n4's 
(the  noise  components  of  the  observations) .  If  the  N^'s 
(the  random  variables  of  which  the  n^'s  are  realizations 
and  hence  the  noise  components  of  the  observations,  x^'s) 
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have  zero  means  as  assumed  in  Section  2. A,  then  the  N^'s 

will  also  have  zero  means.  In  any  sequence  of  differences 

1  rN 

of  order  j,  the  mean  value  of  the  differences  Nj  =  — 
will  also  have  zero  mean.  In  the  absence  of  a  polynomial 
component  with  a  term  artr  and  without  a  disturbance  com¬ 
ponent,  the  r1"*1  order  difference  terms  D  .  =  n  .  and  hence 
^  ri  n 

the  mean  value 


ri 


i  n 

■  i  n. 

n  k  n 


should  be  near  zero.  The  occurrence  of  a  sequence  of  differ¬ 
ences  of  order  r  having  the  same  sign  will  have  a  mean  value 
with  that  same  sign  and  hence  can  be  interpreted  as  an  indi¬ 
cation  of  the  presence  of  another  component.  Further,  a  dis¬ 
turbance  in  the  form  of  an  isolated  disturbance  will  provide 
contributions  of  alternating  signs  to  a  sequence  of  differ¬ 
ences  of  order  r.  Thus  the  reasonable  interpretation  of  the 
sequence  of  similar  signs  is  the  presence  of  a  polynomial  con¬ 
tribution  a  to  the  D  .  1 s . 

r  ri 

Note  that  values  of  which  are  small  with  respect  to 

the  noise  components  of  the  D  '  s  small  in  comparison 

to  a.T  )  can  fail  to  cause  the  sequence  of  D  .  '  s  to  have  the 
N  n 

r  *■ 

sign  of  a  since  a  will  no  longer  dominate  the  n  's. 

r  r  ri 

Thus  the  absence  of  a  sequence  of  D  .  ' s  of  the  same  sign  can 

ri 

not  be  taken  as  an  indication  that  the  polynomial  component  has 
degree  less  than  r.  However,  the  presence  of  a  sequence  of 
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differences  of  order  r  having  the  same  sign  should  be  con¬ 
sidered  as  an  indication  that  the  polynomial  component  will 
be  of  degree  of  at  least  r. 

The  nature  of  the  property  to  be  used  for  identification 
of  appropriate  polynomial  degree  can,  perhaps,  best  be  illus¬ 
trated  by  a  situation  in  which  a  polynomial  of  degree  one 
(P^(t)  =  ag  +  an  t)  is  fitted  by  the  method  of  least  squares 
to  a  set  of  data  with  a  polynomial  component  of  degree  two  (a 
parabola  P^(t))  and  a  small  noise  component.  The  situation 
might  appear  as  sketched  below. 


The  residuals  errors  ei  =  xi  =  have  sequences  of 

similar  signs  (a  sequence  of  negative  signs,  followed  by  a 
sequence  of  positive  signs,  and  ending  with  another  sequence 
of  negative  signs)  .  Fitting  a  polynomial  of  degree  two  to  the 
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same  data  should  produce  a  polynomial  very  close  to 
and  with  residuals  close  to  the  noise  components  and  hence 
with  signs  similar  to  the  signs  of  the  noise  components  which 
are  random. 

The  question  of  how  long  a  sequence  of  D  1 s  of  the 

i 

same  sign  is  required  to  indicate  the  presence  of  a  polynomial 

term  a^  has  not  been  resolved.  For  any  N^_  the  probability 

that  N  is  greater  than  zero  is  0.5.  The  probability  that 
i 

a  sequence  of  positive  values  for  k  such  independent  variables 
is  the  probability  that  a  positive  value  will  be  followed  by 
k-1  positive  values  is 

P  (k  positive  values)  =  (0.5)^  ^  , 

and 

P  (k  _>  5)  =  1  -  P(k  <  s)  =  (0 . 5) s  —  2  . 

Thus 

P  (k  _>  4)  =  0.125,  P  (k  >_  5)  i  0.08,  P  (k  >_  6)  =  0.03. 

Thus  a  sequence  of  six  or  more  successive  differences  of  the 
same  sign  would  be  unlikely  to  occur  do  to  noise  alone, 
the.  noj.A&  componuntA  mhxh  independent.  But  the  noise 
components  are  not  independent  and,  as  established  in  Section 
2.D  are  negatively  correlated.  The  probability  P(k  _>  5) 
is  substantially  less  than  the  value  given  above  in  the  case 
of  independence  and  it  is  suspected  that  a  sequence  of  four 
differences  of  order  k  can  be  taken  as  an  indication  that 
the  polynomial  component  is  at  least  of  degree  k. 
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The  situation  is  complicated  even  further  by  the  fact 
that,  for  example,  fourth  order  differences  involve  only  five 
consecutive  observations  but  the  contemplated  length  of  data 
segments  considered  for  curve  fitting  is  seven  or  eleven. 

It  is  conceivable  that  a  polynomial  fitted  to  the  five  points 
covered  by  a  fourth  order  successive  difference  would  be  of 
a  lower  degree  than  one  fitted  to  a  longer  sequence.  On  the 
other  hand,  if  a  polynomial  of  specified  degree  does  not  fit 
a  sample  of  given  length  very  well,  it  cannot  be  expected  to 
fit  a  sample  of  greater  length  very  well.  Thus  the  informa¬ 
tion  obtained  is  of  a  negative  form  in  that  it  can  be  used 
to  eliminate  lower  degree  polynomials  from  further  consider¬ 
ation. 

There  is  a  temptation  to  apply  standard  sign  tests  or 
the  theory  of  runs  to  sequences  of  successive  differences. 
These,  however,  require  independence  of  noise  components  and 
would  involve  substantially  more  development  to  make  them 
suitable  for  incorporation.  They  could  be  useful  in  the 
curve-fitting  portion  of  the  data  smoothing  program  to  test 
whether  the  polynomial  degree  is  appropriate  by  testing 
whether  the  residual  errors  are  of  random  sign  or  whether 
sign  patterns  exist  as  illustrated  above. 
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3.  APPLICATION  OF  SUCCESSIVE  DIFFERENCES 


The  use  of  successive  differences  in  locating  outliers 
and  in  giving  indication  of  appropriate  polynomial  degree  for 
curve  fitting  will  be  illustrated  for  a  specific  set  of  3-D 
data.  This  data  was  obtained  from  a  test  in  which  a  torpedo 
was  launched  against  a  submarine  at  the  Naval  Undersea  Warfare 
Station.  The  3-D  data  involves  coordinates  recorded  at  equally 
spaced  times  with  very  few  data  points  missing.  Data  for  the 
x  and  y  coordinates  and  a  plot  containing  every  fifth  time 
is  provided  in  the  Appendix. 

Suppose,  now,  that  a  noise  standard  deviation  value 

0=4  is  appropriate  so  that  the  threshold  level  for  the 

fourth  order  differences  is  D|  =  25.1a  =  100.4.  The  first 

threshold  crossings  in  the  data  occur  at  t^  =  908,  909,  910,  911. 

Table  5.1  shows  the  values  of  x. ,  y.  and  the  successive 

l  1  x 

differences  in  the  neighborhood  of  these  points.  (These  are 
reproduced  here  from  the  appendix  for  comparison  with  the 
results  of  treatment.)  The  situation  here  is  somewhat  confused. 

It  does  not  conform  to  the  signature  (pattern)  for  a  single 
isolated  disturbance.  One  possibility  procedure  is  to  declare 
all  four  observations  on  x  and  on  y  as  outliers.  Instead 
of  doing  this  consider  one  point  at  a  time.  Since  the  largest 
magnitudes  of  the  D^ 1  s  occur  at  time  t^  =  909  ,  the  corre¬ 
sponding  values  of  x^  and  y^  will  be  declared  outliers. 
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Replacing  these  values  with  the  average  of  the  values  at 
t^  =  908  and  t^  =  910  yields  the  modified  results  presented 
in  Table  5.2.  All  of  the  fourth  order  successive  differences 
are  now  less  than  D|  and,  moreover,  are  less  than  the  modified 
thresholds  given  in  Table  4.2  (see  Figure  4.1). 

There  may,  and  should,  be  some  doubt  as  to  whether 
declaration  of  the  observations  at  t.  =  909  as  isolated  out¬ 
liers  as  sufficient  treatment  for  this  situation.  As  can  be 
seen  in  Table  5.2,  the  fourth  order  deviations  at  t.  =  911 
are  quite  large  even  though  they  do  not  exceed  their  threshold. 
Further,  the  signatures  at  both  x^  and  y^  are  similar  to 
what  would  be  anticipated  for  isolated  disturbances  at  t  =  911. 
If,  for  example,  the  noise  standard  deviations  were  a  -  3 
instead  of  0=  4,  then  the  x.  and  y.  at  t  =  911  would 
both  exceed  their  thresholds  and  be  declared  outliers.  The 
results  of  this  treatment  are  shown  in  Table  5.3.  All  of  the 
large  successive  differences  have  been  reduced  substantially 
and  the  situation  now  appears  to  be  free  of  disturbances. 
(Reduced  thresholds  for  situations  involving  two  disturbances 
separated  by  a  non-dis turbed  observation  are  not  available 
but  should  be  derived  so  that  the  treatment  could  be  completed.) 

As  a  peripheral  examination  of  this  situation,  the 
possibility  that  the  observations  at  t  =  910  as  the  initial 
outlier  was  examined.  Note  that  the  fourth  order  differences 
at  t  =  909  and  t  =  910  are  reasonably  close  and  could. 
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TABLE  5.1.  SUCCESSIVE  DIFFERENCES  NEAR  t.  =  909 
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TABLE  5.2.  OUTLIER  REPLACED  AT  t.  =  909 


•H 

a 


*H 

oo 

a 


CN 

Q 


•H 

CN 

Q 


00 

CN 

'  00 

00 

00 

00 

CN 

VO 

o 

• 

• 

V  • 

• 

• 

• 

.  / 

• 

• 

• 

00 

in 

\  m 

in 

o> 

vo  / 

VO 

VO 

r— 1 

r— 1 

\ 

\  . 

r— 1 

N* 

T 

CN 

1 

1 

1  / 

1 

- \ - 

- * - 

VO 


in 

• 

VO 

1 

• 

00 

3.4 

-11.9 

i— 1 

CN 

1 

/ 

<N  / 

/ 

/ 

Y  -  . 

-54.2 

22.4 

VO 

rH 

1 

\ 

/ 

CN 

5 

9 

rH  /  O 

«H 1 

00 

• 

•  \  • 

•  / 

t 

• 

o 

I 


00 


\  rH 
\  rH I 
\ 

\ 

— V — 


CN  / 

/ 

1  / 

- - 


o 


N* 

i-H 

I 


r- 

vo 


CN 

<T» 

\  <=> 

o 

/  0 

o 

rH 1 

00 

t 

• 

• 

• 

• 

• 

• 

00 

00 

00 

65 

in 

<J\ 

o 

00 

00 

r- 

\ 

VO 

CN 

00 

00 

VO 

00 

CN 

rH 

l* 

- 7 - 

/h 

CN 

CN 

00 

rH 

• 

• 

• 

• 

\ 

/ 

• 

• 

• 

• 

o 

N* 

<Ti 

\  <N 

/  m 

O 

in 

in 

a\ 

00 

VO 

00 

\  o 

/  vo 

00 

in 

<T> 

CN 

00 

<J\ 

o 

rH 

\  ^ 

/  CN 

00 

00 

00 

rH 

rH 

CN 

CN 

\  CN 

/  CN 

CN 

CN 

CN 

CN 

1 

1 

1 

! 

\ 

/  1 

1 

1 

1 

1 

-H 

00 

rH 

\  - 

CO 

CN 

00 

rH 

/  °. 

oo 

CN 

• 

• 

• 

• 

• 

• 

• 

• 

Q 

rH 

r-* 

VO 

r>* 

/  °° 

rH 

CN 

rH 

CN 

\  * 

00 

00 

00 

rH 

*H 

rr 

\  ^ 

in 

00 

in 

/ 

/  VD 

00 

• 

• 

\ 

• 

• 

• 

/ 

• 

• 

Q 

CN 

\ 

o> 

00 

/  cn 

CO 

CN 

rH 

rH 

V 

00 

/  ^ 

CN 

I  / 


<T> 

LO 

CN 

\  in 

oo 

/  CN 

• 

• 

• 

\ 

• 

/  . 

• 

-11 

O 

-14 

V  <J\ 

\ 

\  i 

o 

00 

-31 

18 

o 

o 

i-H 

I 


r* 

I 


•H 

t 

*  \ 

rH 

• 

rH 

t  00 
/ 

vo 

VO 

rH 

00 

00 

<N  \ 

CN 

CN 

68 

o 

I-H 

rH 

Q 

N* 

«  \ 

r- 

o 

00 

<J\ 

rH 

0^J 

00 

CN 

\  * 

\  rH 

/ 

/  O 

CN 

CN 

CN 

O 

• 

• 

• 

• 

\ 

/ 

• 

• 

• 

• 

00 

in 

00 

\  rH 

/  cn 

O 

O 

00 

00 

CN 

00 

CN 

\  m 

/  r- 

rH 

rH 

CN 

00 

o> 

<J\ 

00 

00 

\ 

/  vo 

VO 

in 

N* 

00 

00 

00 

00 

00 

\  oo 

/  oo 

00 

00 

00 

00 

CN 

CN 

CN 

CN 

\  CN 
\ 

/  - 

CN 

CN 

CN 

CN 

in 

vo 

r- 

00 

<J\ 

o 

rH 

CN 

00 

N* 

o 

o 

o 

o 

o 

rH 

rH 

rH 

rH 

rH 

<j\ 

<j\ 

<J\ 

<T> 

a\ 

<T> 

69 


TABLE  5.3.  OUTLIERS  REPLACED  AT  t.  =  909,  911 
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possibly  have  been  reversed  in  order  of  magnitude  by  the  noise 
components-  The  results  are  presented  in  Table  5.4.  Both 
and  y^  at  t  =  909  are  now  indicated  as  outliers,  exceeding 
not  only  the  modified  thresholds  but  the  general  threshold 
D|  =  100.4.  Replacing  both  points  as  outliers  yields  the  results 
shown  in  Table  5.5.  An  interesting  outcome  should  be  noted. 

The  fourth  order  differences  for  both  x  and  y  at  t  =  910 
now  exceed  the  modified  threshold  appropriate  for  situations 
involving  adjacent  missing  points,  namely,  D*  g^g  =  5.1a  =  20.4. 

(See  Table  4.4.)  But  the  observations  at  t  =  910  have  already 
been  modified.  This  suggests  that  the  observations  at  t  =  910 
should  not  have  been  considered  outliers  initially. 

The  situation  in  the  vicinity  of  t  =  910  in  the  data 
provides  illustration  of  several  features  of  the  use  of 
successive  differences  in  identification  of  outliers.  First, 
identification  of  outliers  by  successive  differences  can  be 
awkward  when  there  are  several  threshold  crossings  adjacent 
to  each  other.  As  can  be  seen  in  the  situation  with  threshold 
crossings  at  times  t  =  908,  909,  910,  and  911,  rejection  of 
the  observations  at  t  =  909  and  911  appear  to  be  sufficient 
to  reduce  the  ordered  differences  to  magnitudes  that  could  be 
produced  by  noise.  A  procedure  involving  rejection  of  one 
of  the  observations  at  a  time  starting  with  the  largest  one 
and  recalculating  the  successive  differences  to  be  examined 
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TABLE  5.4.  OUTLIER  AT  t.  =  910 
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TABLE  5.5.  OUTLIERS  REPLACED  AT  t.  =  909,  910 
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for  other  threshold  crossings  seems  reasonable.  If  several  of 
the  successive  differences  have  nearly  the  same  magnitudes, 
however,  this  could  lead  to  rejection  of  the  wrong  observations, 
again,  as  demonstrated  by  rejecting  the  observations  at 
t  =  910  first. 

The  second  feature  of  this  example  is  an  outgrowth  of 
the  first.  An  algorithm,  and  the  subsequent  computer  program, 
which  will  provide  satisfactory  treatment  for  multiple  adjacent 
threshold  crossings  will  be  awkward  to  produce.  Nevertheless, 
merely  identifying  such  situations  and  relegating  them  for 
manual  processing  should  be  avoided  since  it  contradicts  the 
objective  of  complete  automatic  processing. 

The  third  feature  arises  when  the  first  order  differences 
are  examined.  There  appears  to  be  a  substantial  change  in 
velocity  (the  a^  term  of  the  polynomial  component)  in  both 
the  x  and  y  coordinates.  The  possibility  of  the  perturbation 
in  the  vicinity  of  t  =  909  being  due  to  a  change  in  the 
polynomial  component  instead  of,  or  in  addition  to,  disturbances 
causing  outliers  should  be  considered.  This  situation  should 
be  re-examined  when  curve-fitting  to  the  data  is  attempted. 

One  final  comment  on  this  situation  1  The  analysis 

was  performed  by  consideration  of  the  fourth  order  differences 

(the  D^'s)  only.  It  appears  that  the  second  and  third 

order  differences  confirm  the  indications  of  the  D..'s  but 

4i 

add  little  of  a  supplementary  nature.  Again,  this  points  to 
the  use  of  only  one  order  of  differences  for  indication  of 
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outliers  and  the  preference  should  be  for  the  higher  order 
as  containing  the  least  contamination  by  any  polynomial 
component  in  the  observations. 

Another  example  of  a  threshold  crossing  occurs  at 
t  =  851  (Table  6.1) .  Note  that  in  this  situation  only  the 
y  coordinate  produces  a  crossing.  The  question  as  to  whether 
the  observation  at  x  should  also  be  rejected  must  be  con¬ 
sidered.  In  order  to  answer  this  question  it  may  be  necessary 
to  examine  the  data  collection  process  (e.g.,  the  sensors  and 
the  geometry  of  the  situation) .  The  results  of  replacing 
both  the  x  and  y  observations  at  t  =  851  are  presented 
in  Table  6.2.  Whether  the  improvement  in  the  x  coordinates 
is  worth  the  effort  is  debatable  at  this  stage. 

A  third  event  of  threshold  crossings  in  the  data  occurs 

in  the  vicinity  of  t  =  893.  Again,  multiple,  adjacent 

crossings  occur  but  only  in  the  y  coordinates.  (See  Table  7.1.) 

The  successive  differences  after  replacing  the  observations 

at  t  =  893  are  shown  in  Table  7.2  and  after  replacing  the 

observations  at  both  t  =  893  and  t  =  890  in  Table  7.3. 

Although  the  D^'s  are  well  below  the  general  bound 

D|  =  25.1a  for  a  =  4  or  a  =  3,  they  exceed  the  modified 

bounds  given  in  Table  4 . 1  for  observations  in  the  vicinity 

of  a  single  missing  point.  This  situation  has  not  been 

pursued  further.  As  in  the  two  situations  already  discussed 

(vicinities  of  t  =  851  and  t  =  909),  there  appears  to 

be  a  substantial  change  in  the  velocity  components  of  the 

vehicular  path  as  evidenced  by  the  values  of  the  D. . ' s . 

li 
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TABLE  7.1.  SUCCESSIVE  DIFFERENCES  NEAR  t.  =893 


00 

O 

CM 

H  \ 

as 

r- 

CO 

r- 

^  / 

o 

CM 

CM 

in  ' 

r- 

co 

in 

o 

m  / 

H 

in 

OS 

as  \ 

CM 

rH 

<N 

co 

/ 

i 

i  \ 

H 

CM 

1 

CM 

H 

l 

/ 

/ 

H 

o\ 

CO 

- v - 

H  \ 

00 

as 

co 

• 

• 

• 

•  \ 

• 

# 

• 

• 

co 

o 

H 

H  \ 

CO 

* 

as 

in 

in 

H 

in 

H  \ 

00 

CM 

as 

co 

\ 

H 

CO 


in 

in 

as 

CM 

\  0 

CO 

H  / 

*  / 

CM 

H 

H 

• 

• 

• 

• 

• 

• 

• 

• 

CM 

in 

in 

in 

00 

\  ^ 

21 

CO 

Q 

CO 

H 

CM 

\  •« 

r* 

H 

o 

in 

as 

o 

CM 

\  ^ 

c*  / 

00 

o 

• 

# 

• 

• 

• 

\ 

•  / 

• 

• 

H 

CM 

H 

in 

TT 

\  00 

CM  / 

H 

H 

Q 

co 

r* 

m 

00 

\  CM 
\ 

O  / 

H  / 

00 

C\ 

1 

i 

l 

i 

1 

\  1 
\ 

- \ - 

1  / 

/ 

- * - 

1 

i 

m 

m 

H 

o 

o 

CM 

\  00 

/  r- 
/ 

in 

in 

• 

• 

• 

# 

• 

• 

• 

• 

o 

CM 

as 

H 

r* 

H 

N  as 

/  ^ 

7  00 

o 

m 

o 

co 

H 

n 

in 

in 

in 

in 

in 

in 

in 

r- 

r- 

00 

<T> 

o 

H 

00 

co 

rr 

as 

\ 

\ 

00 

H 

as 

H 

/ 

in 

•H 

• 

• 

• 

# 

\ 

• 

• 

• 

• 

• 

/ 

• 

o 

co 

CO 

in 

\ 

co 

CO 

r^ 

in 

/ 

co 

Q 

H 

co 

H 

\ 

CO 

r- 

r- 

co 

/ 

1 

1 

\ 

1 

/ 

1 

/ 

V 

i 

f — 

H 

CM 

CM 

co 

V 

in 

in 

CO 

00 

/ 

CM 

• 

• 

• 

• 

\ 

# 

• 

• 

• 

/ 

• 

CO 

TT 

00 

co 

V 

o 

co 

o 

n 

/ 

/ 

/ 

CO 

Q 

CM 

H 

\ 

\ 

CO 

rr 

CO 

H 

1 

\ 

1 

1 

/ 

\ 

\ 

“0 

/ 

/ 

r— 

o 

H 

H 

as 

H 

in 

00 

o 

CM 

/ 

• 

• 

CM 

in 

o 

o 

CM 

\ 

00 

in 

TT 

/ 

00 

in 

Q 

CM 

\ 

CM 

H 

H 

/ 

\  I 
\ 


I  / 
/ 


H 

in 

in 

in 

in 

o 

'  as 

H  / 

in 

in 

H 

• 

• 

• 

• 

• 

\ 

.  / 

• 

• 

Q 

in 

r- 

as 

00 

H 

\  ^ 

CO  j 

co 

in 

as 

00 

in 

n 

"  l 

co 

in 

O 

in 

H 

r- 

-  \ 

in 

/  ° 

in 

CM 

• 

• 

• 

/  • 

o 

in 

in 

in 

co 

rr  \ 

r- 

/ 

in 

in 

co 

o 

r- 

00 

7 

00 

CM 

in 

in 

r- 

r- 

00 

00 

o 

co 

co 

co 

co 

co 

CO 

CO 

CO 

CO 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

* 

CO 

in 

in 

as 

as 

as 

as 

as 

00 

00 

00 

00 

00 

r- 

oo 

oo 


oo 

oo 

oo 


(T\ 

00 

00 


o 

as 

00 


as 

00 


78 


rn 

oo 

II 

•p 


Eh 

< 

Q 

W 

U 

c 

cu 


w 

05 

W 

M 

hi 

Eh 

D 

O 


CN 

p* 

W 

■-5 

m 

< 

Eh 


O 


rH  \ 

P* 

VO 

<J\ 

•H 

.  \ 

• 

• 

• 

rn 

\ 

VO 

00 

in 

CN 


Q 


TJ» 

Q 


(O 

a 


CN 

Q 


Q 


cr> 

oo 

oo 


oo  / 
•  / 
rH  / 


! 


« \ 

LO 

rH 

o 

•  \ 

• 

• 

0 

oo  \ 

00 

O 

VO 

CN  X 

rH 

rH 

'  / 
L- 


CN 

rH 

I 


\ 

/ 

CN 

\ 

p* 

00 

/ 

00 

• 

\ 

• 

• 

/ 

• 

\ 

LO 

un 

/ 

rH 

00 

\ 

VO 

VO 

/ 

00 

1 

\ 

! 

i 

/ 

1 

\ 

j 

r 

\ 

/ 

\ 

* 

/ 

CN 

\ 

O 

/ 

P* 

• 

\ 

0 

/ 

• 

H 

\ 

P* 

/ 

CN 

un 

rH 

t 

CO 

p* 

00 

00 

rn 

\  00 

un 

CN 

C\ 

• 

\ 

• 

• 

0 

co 

-22 

20 

P* 

i 

o 

1 

\ 

rH 

~^~T 

o 

CN 

V 

\  o 

O 

r*  / 

• 

00 

\  CN 

/ 

\  I 
\ 

— V- 


I  / 

/ 

— * — 


o 

0 

r— I 

p* 


VO 

k  • 

\  ° 

\LD 

i 


o 

LO 


VO 


CO 

TT 


p> 

\  *  / 

\  00  / 

o 

0 

\  *  / 

• 

\  *0  / 

VO 

ON  , 

00 

00 

Ol » 

rn 

rn 

rn 

CN 

rH 

CN 

O 

a\ 

oo 


On 

00 


CN 

^  \ 

00 

m 

p- 

P- 

^  / 

o 

• 

• 

• 

• 

• 

•  / 

• 

CN 

un  \ 

o 

un 

CN 

P- 

on  / 

p- 

C^ 

\ 

on 

VO 

rH 

/ 

^  \ 

rH 

rn 

p* 

rn 

•""*  / 

VO 

0 

0 

• 

• 

•  / 

• 

un  \ 

VO 

rn 

p* 

VO 

rr  / 

rn 

CN 

CN 

rH  / 

CN 

0 

rn 


CN 

rn 

un 

VO 

CTk 

on 

CT> 

a\ 

a\ 

00 

00 

00 

00 

00 

79 


TABLE  7.3.  OUTLIERS  REPLACED  AT  t.  =  890,  893 
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The  three  situations  examined  above  are  the  only  ones 

in  which  values  of  D..'s  exceed  the  threshold  D*  =  25.1a 

4i  4 

=  100.4  with  a  =  4.  In  all  three  situations  the  values  of 
the  ' s  indicate  that  there  is  a  possibility  of  a  pertur¬ 

bation  in  the  form  of  a  change  in  the  polynomial  component 
of  the  observations.  It  would  thus  appear  desirable  to  post¬ 
pone  further  screening  for  outliers  until  the  curve-fitting 
portion  of  the  data  smoothing  effort.  After  such  treatment 
of  this  data  set  and,  possibly,  experience  gained  from 
examination  of  other  data  sets,  the  desirability  of  finer 
screening  for  outliers  using  successive  differences  should 
be  reassessed. 

The  final  comments  on  the  data  set  considered  here 
pertains  to  information  provided  by  successive  differences 
on  the  appropriate  degree  of  the  polynomial  to  be  used  in 
curve  fitting.  As  described  in  Section  2.1,  the  primary 
evidence  to  be  considered  here  is  the  existence  of  sequences 
of  successive  differences  of  a  given  order  having  the  same 
sign.  Naturally,  sequences  of  D,Vs  having  the  same  sign 
occur  in  the  data  and  would  be  expected  for  a  torpedo  path 
since  a  torpedo  without  a  velocity  cannot  hope  to  intercept 
its  target.  No  attempt  to  fit  a  polynomial  of  degree  less 
than  one  is  contemplated.  The  only  occurrences  of  sequences 
of  D^'s  or  D^^'s  with  the  same  signs  and  having  length 
greater  than  four  start  at  t  =  859  and  t  =  863.  Since 


81 


'  I 


the  probability  that  a  sequence  of  similar  signs  of  length 
greater  than  S  =  4  is  P(k  _>  5)  =  (0.5) ^  =  0.167  (if  the 
differences  were  due  to  noise  only  and  the  noise  components 
of  the  differences  were  independent) .  The  reduced  probability 
of  this  event,  due  to  the  lack  of  independence,  suggests  that 
the  polynomials  to  fit  both  the  x  and  y  coordinates 
in  the  segments  t  =  851  to  t  =  867  should  be  of  degree 
at  least  three  and,  more  likely,  four.  Examination  of  the  plot 
of  the  torpedo  path  shown  in  the  appendix  indicates  that  this 
is,  indeed,  the  segment  of  the  torpedo  path  where  the  greatest 
changes  occurred. 
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4.  CONCLUSIONS  AND  RECOMMENDATIONS 


During  the  process  of  model  development  and  its  sub¬ 
sequent  application  to  data  from  a  torpedo  path  it  should 
be  evident  that  successive  differences  provide  some  capability 
for  detection  of  outliers.  For  practical  purposes,  an  'outlier 
can  be  defined  as  an  observation  whose  magnitude  is  unreason¬ 
ably  large  when  only  its  polynomial  and  noise  components  are 
considered.  An  algorithm  for  using  successive  differences  to 
detect  outliers  is  presented  in  Section  2.H.  In  this  algorithm, 
attention  is  centered  on  the  fourth  order  successive  differ¬ 
ences  (the  D^'s)  and  successive  differences  of  lower  orders 
are  ignored  in  screening  for  outliers. 

As  a  secondary  use,  successive  differences  provide 
some  indication  of  appropriate  polynomial  degrees  for  the  curve 
fitting  portion  of  the  data  smoothing  process.  This  information 
is  negative  in  form  with  a  substantial  sequence  of  similar 
signs  for  successive  differences  of  a  given  order  providing 
evidence  that  a  polynomial  of  degree  lower  than  that  order 
cannot  be  expected  to  provide  an  acceptable  fit  to  the  data 
which  produced  that  sequence . 

The  outline  for  the  algorithm  presented  in  Section  2.H 
requires  additional  development  before  it  can  be  incorporated 
in  a  data  smoothing  program.  The  primary  need  here  is  for  a 
more  thorough  treatment  for  situations  involving  missing 
points . 
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Since  outliers  are  to  be  identified  by  crossings  of 
threshold  values  by  successive  differences  and  since  these 


threshold  values  are  specified  in  terms  of  the  standard  deviation 
a  of  the  noise,  the  selection  of  an  appropriate  value  for  a 
is  fundamental  to  the  screening  process.  Potential  sources 
for  values  for  a  are  the  data  gathering  system  and  the  data 
available  from  torpedo  paths. 

The  possibility  of  modifying  the  thresholds  (conceptually 
by  using  a  smaller  value  for  the  coefficient  of  a  in  Section  2.D) 
to  remove  some  of  the  outliers  identified  in  the  subsequent 
curve-fitting  portion  of  the  data  smoothing  process  should 
be  examined.  Any  such  outliers  that  can  be  identified  by 
successive  differences  can  provide  substantial  reductions  in 
repetitions  of  curve-fitting  to  the  affected  data  segments. 

Further,  the  possibility  of  using  missing  points  in  selecting 
appropriate  data  segments  for  curve-fitting  will  be  facilitated 
by  early  identification  of  missing  points  caused  by  elimination 
of  outliers.  This  use  will  be  discussed  in  a  subsequent 
report. 
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APPENDIX  A 


DATA  FROM  A  TORPEDO  PATH  AT  NUWES 

The  model  developed  in  this  report  was  applied  to 
data  collected  on  a  specific  test  in  which  a  torpedo  was 
launched  against  a  submarine  at  the  Naval  Undersea  Warfare 
Engineering  Station.  A  major  part  of  the  torpedo  path  is 
sketched  in  the  accompanying  figure  and  the  data  is  listed 
in  the  table  which  follows.  Only  the  x  and  y  coordinates 
are  included. 
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3.2 

-16.4 

-77.3 

19.4 

59.8 

-  6.9 

ci 

Xi 

°li 

°2i 

°3i 

°4i 

yi 

°li 

°2i 

°3i 

°4i 

820 

24800.8 

8.2 

-38.0 

-3105.8 

-  3.7 

17.0 

-69.1 

-18.6 

56.1 

10.1 

821 

24731.7 

-10.4 

39.9 

-3049.7 

6.4 

-22.6 

-79.5 

21.3 

62.5 

-12.5 

822 

24652.2 

10.9 

-36.5 

-2987.2 

-  6.1 

22.5 

-68.6 

-15.2 

56.4 

10.0 

823 

24583.6 

-  4.3 

21.9 

-2930.8 

3.9 

-14.5 

-72.9 

6.7 

60.3 

-  4.5 

824 

24510.7 

2.4 

-11.8 

-2870.5 

-  0.6 

6.2 

-70.5 

-  5.1 

59.7 

1.  7 

825 

24440.2 

-  2.7 

11.0 

-2810.8 

1.1 

-  3.9 

-73.2 

5.9 

60.8 

-  2.2 

826 

24367.0 

3.2 

-10.0 

-2750.0 

-  1.1 

7.2 

-70.0 

-  4.1 

59.7 

5.0 

82  7 

24297.0 

-  0.9 

3.4 

-2690.3 

3.9 

-17.4 

-70.9 

-  0.7 

63.6 

-12.4 

828 

24226.1 

-  1.6 

5.2 

-2626.7 

-  8.5 

25.8 

-72.5 

4.5 

55.1 

13.4 

829 

24153.6 

2.9 

-  4.1 

-2571.6 

4.9 

-15.8 

-69.6 

0.4 

60.0 

-  2.4 

830 

24084.0 

3.3 

13.5 

-2511.6 

2.5 

-18.  3 

-66.3 

13.9 

62.5 

-20.7 

831 

24017.7 

17.2 

-26.0 

-2449.1 

-18.2 

42.3 

-49.1 

-12.1 

44.3 

21.6 

89 


ci 

Xi 

Dli 

°2i 

°3i 

°4i 

yi 

°li 

°2i 

°3i 

°4i 

832 

23968.6 

5.1 

-  5.6 

-2404.8 

3.4 

-24.  7 

-44.0 

-17.7 

47.7 

-  3.1 

833 

23924.6 

-12.6 

36.5 

-2357.1 

0.3 

-  2.2 

-56.6 

18.8 

48.0 

-  5.3 

834 

23868.0 

6.2 

-46.7 

-2309.1 

-  5.0 

30.3 

-50.4 

-27.9 

43.0 

25.0 

835 

23817.6 

-21.7 

49.0 

-2266.1 

20.0 

-46.7 

-72.1 

21.1 

63.0 

-21.  7 

836 

23745.5 

-  0.6 

-18.4 

-2203.1 

-  1.7 

27.3 

-72.  7 

2.7 

61.3 

5.6 

837 

23672.8 

2.1 

2.6 

-2141.8 

3.9 

-12.9 

-70.6 

5.3 

65.2 

-  7.3 

838 

23602.2 

7.4 

-17.7 

-2076.6 

-  3.4 

18.4 

-63.2 

-12.4 

61.8 

11.1 

839 

23539.0 

-  5.0 

20.1 

-2014.8 

7.7 

-21.6 

-68.2 

7.  7 

69.5 

-10.5 

840 

23470.8 

2.7 

-13.6 

-1945.3 

-  2.8 

22.4 

-65.5 

-  5.9 

66.7 

11.9 

841 

23405.3 

-  3.2 

6.9 

-1878.6 

9.1 

-15.8 

-68.  7 

1.0 

75.8 

-  3.9 

842 

23336.6 

-  2.2 

8.1 

-1802.8 

5.2 

-13.0 

-70.9 

9.1 

81.0 

-16.9 

843 

23265. 7 

6.9 

-14.4 

-1721.8 

-11.  7 

35.2 

-64.0 

-  5.3 

69.3 

18.3 
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ci 

Xi 

°li 

°2i 

°3i 

°4i 

yi 

°li 

°2i 

°3i 

°4i 

844 

23201.7 

1.6 

5.0 

-1652.5 

6.6 

-29.7 

-62.4 

-  0.3 

75.9 

-11.4 

845 

23139.3 

1.3 

-  6.9 

-1576.6 

-  4.8 

13.3 

-61.1 

7.2 

71.1 

1.9 

846 

23078.2 

-  5.9 

18.2 

-1505.5 

-  2.9 

6.1 

-67.0 

11.0 

68.2 

8.0 

84  7 

23011.2 

5.1 

-14.2 

-1437.3 

5.1 

-12.0 

-61.9 

-  3.2 

73.3 

-  4.0 

848 

22949.3 

1.9 

0.5 

-1364.8 

1.1 

2.5 

-60.0 

-  2.7 

74.4 

-  1.5 

849 

22889.3 

-  0.8 

12.8 

-1289.6 

-  0.4 

-15.6 

-69.8 

10.1 

74.0 

-17.1 

850 

22828.5 

9.3 

-42.4 

-1215.6 

-17.5 

66.9 

-51.5 

-32.3 

56.5 

49.8 

851 

22777.0 

-23.0 

45.1 

-1159.1 

32.3 

-133.4 

-74.5 

12.8 

88.8 

-83.6 

852 

22702.5 

-10.2 

-11.4 

-1070.3 

-51.3 

98.4 

-84.  7 

1.4 

37.5 

14.8 

853 

22617.8 

-  8.8 

16.6 

-1032.8 

-36.5 

-23.3 

-93.5 

18.0 

1.0 

-  8.5 

854 

22524.3 

9.2 

2.8 

-1031.8 

-45.0 

25.1 

-84.3 

20.8 

-44.0 

16 . 6 

855 

22440.0 

30.0 

-12.4 

-1075.8 

-28.4 

-  7.5 

-54.3 

8.4 

1  -72.4 

9.1 
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ci 

Xi 

Dli 

»u 

D3i 

D4i 

i 

i 

yi 

Dli 

°2i 

°3i 

D4i 

856 

22385.7 

38.4 

-  5.2 

-1148.2 

-19.3 

13.0 

-15.9 

3.2 

-91.7 

22.1 

857 

22369.8 

41.6 

-59.9 

-1239.9 

2.8 

-27.4 

25.7 

-56.7 

-88.9 

-  5.3 

858 

22395.5 

-15.1 

28.2 

-1328.8 

-  2.5 

10.7 

10.6 

-28.5 

-91.4 

5.4 

859 

22406.1 

-43.6 

37.3 

-1420.2 

2.9 

15.8 

-33.0 

8.8 

-88.5 

21.2 

860 

22373.1 

-34.8 

4.6 

-1508.7 

24.1 

-  5.9 

-67.8 

i 

13.4 

-64.4 

15.3 

861 

22305.3 

-21.4 

5.8 

-1573.1 

39.4 

-12.9 

-89.2 

19.2 

-25.0 

2.4 

862 

22216.1 

-  2.2 

-  1.3 

-1598.1 

41.8 

-  7.3 

-91.4 

17.9 

16.8 

-  4.9 

863 

22124. 7 

15.7 

-  0.1 

-1581.3 

36.9 

-  2.1 

\ 

-75.7 

17.8 

53.7 

-  7.0 

864 

22049.0 

33.5 

-13.6 

-1527.6 

29.9 

-13.3 

-42.2 

4.2 

83.6 

-20.3 

865 

22006.8 

37.7 

-27.7 

-1444.0 

9.6 

12.8 

-  4.5 

-23.5 

93.2 

-  7.5 

866 

22002.3 

14.2 

17.6 

-1350.8 

2.1 

4.3 

9.7 

-  5.9 

95.3 

-  3.2 

867 

22012.0 

8.3 

5.7 

-1255.5 

-  1.1 

1.2 

18.0 

-  0.2 

94.2 

-  2.0 
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ci 

Xi 

Dli 

°2i 

°3i 

°4i 

yi 

°11 

°21 

°31 

°41 

868 

22030.0 

8.1 

0.9 

-1161.3 

-  3.1 

2.1 

26.1 

0.7 

91.1 

0.1 

869 

22056.1 

8.8 

-  1.2 

-1070.2 

-  3.0 

1.8 

34.9 

-  0.5 

88.1 

1.9 

870 

22091.0 

8.3 

-  2.0 

-  982.1 

-  1.1 

-  8.7 

43.2 

-  2.5 

87.0 

-  6.8 

871 

22134.2 

5.8 

6.3 

-  895.1 

-  7.9 

-13.3 

49.0 

3.8 

79.1 

-  6.5 

872 

22183.2 

9.6 

-  8.3 

-  816.0 

-  1.4 

-14.3 

58.6 

-  4.5 

77.7 

-  7.8 

873 

22241.8 

5.1 

7.3 

-  738.3 

-  9.2 

14.1 

63.7 

2.8 

68.5 

6.3 

874 

22305.5 

7.9 

-  7.8 

-  669.8 

-  2.9 

-13.4 

71.6 

-  5.0 

65  .6 

-  7.1 

875 

22377.1 

2.9 

9.8 

-  604.2 

-10.0 

12.3 

74.5 

4.8 

55.6 

5.2 

876 

22451.6 

7.7 

-  8.9 

-  548.6 

-  4.8 

-  8.0 

82.2 

-  4.1 

50.8 

-  2.8 

877 

22533.8 

3.6 

2.8 

-  497.8 

-  7.6 

2.0 

85.8 

-  1.3 

43.2 

-0.8 

878 

22619.6 

2.3 

2.3 

-  454.6 

-  8.4 

1.2 

88.1 

1.5 

34.8 

0.4 

879 

22707.7 

3.8 

-  5.2 

-  419.8 

-  8.0 

-  0.8 

91.9 

-  3.7 

26.8 

-  0.4 
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ci 

X. 

1 

Dli 

°2i 

°3i 

D.  • 

4i 

yi 

Dli 

°2i 

°3i 

°4i 

880 

22799.6 

0.1 

7.3 

-  393.0 

-  8.4 

-  1.8 

92.0 

3.6 

18.4 

-  2.2 

881 

22891.6 

3.7 

-  7.1 

-  374.6 

-10.6 

5.7 

95.7 

-  3.5 

7.8 

3.5 

882 

22987.3 

0.2 

1.7 

-  366.8 

7.1 

-  7.5 

95.9 

-  1.8 

0.7 

-  4.0 

883 

23083.2 

-  1.6 

7.8 

-  366.1 

-11.1 

2.  3 

94.3 

6.0 

-10.4 

-  1.7 

884 

23177.5 

4.4 

-15.3 

-  376.5 

-12.8 

11.2 

98.7 

-  9.3 

-23.2 

9.5 

885 

23276.2 

-  4.9 

10.9 

-  399.7 

-  3.3 

-14.1 

93.8 

1.6 

-26.5 

-  4.6 

886 

23370.0 

-  3.3 

-  3.3 

-  426.2 

-  7.9 

4.9 

90.5 

-  1.7 

-34.4 

0.3 

887 

23460.5 

-  5.0 

10.8 

-  460.6 

-  7.6 

12.8 

85.5 

9.1 

-42.0 

13.1 

888 

23546.0 

4.1 

-33.3 

-  502.6 

5.5 

-54.0 

89.6 

-24.2 

-36.5 

-40.9 

889 

23635.6 

-20.1 

43.4 

-  539.1 

-35.4 

92.2 

69.5 

19.2 

-71.9 

51.3 

890 

23705.1 

-  0.9 

-15.9 

-  611.0 

15.9 

-95.4 

68.6 

3.3 

-56.0 

-44.1 

891 

23773.7 

2.4 

-33.8 

-  667.0 

-28.2 

127.9 

71.0 

-30.5 

-84.2 

83.8 
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ci 

Xi 

Dli 

D2i 

D3i 

D4i 

yi 

Dli 

°2i 

°3i 

°4i 

892 

23844.7 

-28.1 

74.1 

-  751.2 

55.6 

-213.7 

42.9 

43 . 6 

-  28.6 

-129.9 

893 

23887.6 

15.5 

-73.9 

-  779.8 

-74.3 

225.3 

58.4 

-30.3 

-102.9 

95.4 

894 

23946.0 

-14.8 

37.1 

-  882.7 

21.1 

-130.7 

43.6 

6.8 

-81.8 

>-35.3 

895 

23989.6 

-  8.0 

6 .4 

-  964.5 

-14.2 

46 . 4 

35.6 

13.2 

-  96.0 

11.1 

896 

24025.2 

5.2 

-43.6 

-1060.5 

-  3.1 

7.0 

40.8 

-30.4 

-99.1 

18.1 

89  7 

24066.0 

-25.2 

42.1 

-1159.6 

15.0 

-  46.6 

15.6 

11.7 

-84.1 

-28.5 

893 

24081.6 

-13.5 

14.2 

-1243.7 

-13.5 

43.2 

2.1 

25.9 

-  97.6 

-14.7 

899 

24083.7 

12.4 

-55.7 

-1341.3 

1.2 

-19.4 

14.5 

-29.8 

-  96.4 

-  4.7 

900 

24098.2 

-17.4 

34.5 

-1437.7 

-  3.5 

12.0 

-  2.9 

4.7 

-  99.9 

7.3 

901 

24095.3 

-12.7 

-11.5 

-1537.6 

3.8 

-  0.4 

-15.6 

-  6.8 

-  96.1 

6.9 

902 

24079.7 

-19.5 

36.9 

-1633.7 

10.  7 

-21.2 

-35.1 

30.1 

-85.4 

-14.3 

903 

24044.6 

10.6 

-53.2 

-1719.1 

3.6 

17.4 

-24.5 

-23.1 

-89.0 

3.  7 
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ci 

Xi 

°li 

°2i 

°3i 

°4i 

yi 

°li 

°2i 

°3i 

°4i 

904 

24020.1 

-12.5 

23.7 

-1808.1 

-  0.5 

-  3.7 

-37.0 

0.6 

-89.5 

6.8 

905 

23983.1 

-11.9 

11.8 

-1897.6 

6.3 

-13.3 

-48.9 

12.4 

-83.2 

-  6.5 

906 

23934.2 

0.5 

-27.1 

-1980.8 

-  0.2 

15.2 

-48.4 

-14.7 

-83.4 

8.7 

90  7 

23885.8 

-14.2 

49.3 

-2064.2 

8.5 

-36. 7 

-62.6 

34 . 6 

-74.9 

- .23.0 

908 

23823.2 

20.4 

-114.8 

-2139.1 

-19.5 

110.3 

-42.2 

-80.2 

-94.4 

'82.3 

909 

23781.0 

-59.8 

173.2 

-2233.5 

62.8 

-173.6 

-102.0 

93.0 

-31.6 

-  96.3 

910 

23679.0 

33.2 

-157.4 

-2265.1 

-33.5 

169.9 

-68.8 

-64 . 4 

-65  .1 

73.6 

911 

23610.2 

-31.2 

114.0 

-2330.2 

40.1 

-127.8 

-100.0 

49.6 

-25.0 

-54.2 

912 

23510.2 

18.4 

-  78.0 

-2355.2 

-14.1 

76.6 

-81.6 

-28.4 

-39.1 

22.4 

913 

23428.6 

-10.0 

31.3 

-2394.3 

8.3 

-24.0 

-91.6 

2.9 

-30.8 

-  1.6 

914 

23337.0 

-  7.1 

12.2 

-2425.1 

6.7 

6 . 4 

-98.7 

15.1 

-24.1 

4.8 

915 

23238.3 

8.0 

-29.9 

-2449.2 

11.5 

-  9.6 

-90.7 

-14.8 

-12.6 

-  4.8 
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ci 

Xi 

Dli 

°2i 

°3i 

°4i 

yi 

Dli 

°2i 

°3i 

°4i 

916 

23147.6 

-  6.8 

16.8 

-2461.8 

6.7 

6.4 

-  97.5 

2.9 

-  5.9 

1.6 

917 

23050.1 

-  4.8 

12.1 

-2467.7 

8.3 

2.2 

-102.3 

14.1 

2.4 

3.8 

913 

22947.8 

9.3 

-25.4 

-2465.8 

12.1 

-13.1 

-  93.0 

-11.3 

14.5 

-9.3 

919 

22854.8 

-  2.0 

15.6 

-2450.8 

2.8 

19.5 

-  95.0 

4.3 

17.3 

10.2 

920 

22759.8 

2.3 

-  0.8 

-2433.5 

13.0 

-15.5 

-  92.7 

3.5 

30.3 

-5.3 

921 

22667.1 

5.8 

-  8.4 

-2403’.  2 

7.7 

4.5 

-  86.9 

-  4.9 

38.0 

-  0.8 

922 

22580.2 

0.9 

11.5 

-2365.2 

6.9 

I 

1 

2.2 

-  86.9 

6.6 

44.9 

I  1  4 

923 

22494.2 

7.5 

-12.8 

-2320.3 

8.3 

-  4.3 

-  78.5 

-  6.2 

53.2 

-2.9 

924 

22415.7 

1.3 

13.6 

-2267.1 

5.4 

6.2 

-  77.2 

7.4 

58.6 

3.3 

925 

22338.5 

8.7 

-12.3 

-2208.5 

8.7 

-  9.7 

-  68.5 

-  4.9 

67.3 

-6.4 

926 

22270.0 

3.8 

10.5 

-2141.2 

2.3 

15.5 

-64.7 

5.6 

69.6 

9.1 

927 

22205.3 

9.4 

-  9.6 

-2071.6 

11.4 

-21.1 

-55.3 

-  4.0 

81.0 

-12.0 

| 
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ci 

Xi 

Dli 

D2i 

D3i 

°4i 

yi 

Dli 

°2i 

°3i 

°4i 

928 

22150.0 

-  5.4 

5.4 

-1990.6 

-  0.6 

17.7 

- 

• 

1.4 

80.4 

5.7 

929 

22100.1 

6.8 

— 

0.5 

-1910.2 

5.1 

-  5.8 

- 

1.9 

85.5 

-  0.1 

930 

22057.0 

8.7 

-  1.5 

-1824.7 

5.0 

-  3.3 

- 

0.4 

90.5 

-  3.4 

931 

22022.6 

9.1 

-  1.5 

-1734.2 

1.6 

3.5 

-25.3 

-  1.1 

92.1 

0.1 

932 

21997.3 

8.0 

2.5 

-1642.1 

1.7 

0.7 

-17.3 

1.4 

93.8 

0.8 

933 

21980.0 

9.4 

-  4.4 

-1548.3 

2.5 

-  5.3 

-  7.9 

-  3.0 

96.3 

-  4.5 

934 

21972.1 

6.4 

6.7 

-1452.0 

-  2.0 

7.3 

-  1.5 

3.7 

94.3 

2.8 

935 

21970.6 

10.1 

-  4.8 

-1357. 7 

0.3 

-  3.4 

8.6 

-  1.1 

95.1 

-  0.6 

936 

21979.2 

9.0 

0.4 

-1262.6 

0.2 

-  3.5 

17.6 

-  0.7 

95.3 

-  4.1 

937 

21996.8 

8.3 

0.0 

-1167.3 

-  3.9 

7.9 

25.9 

0.2 

91.4 

3.3 

938 

22022.7 

8.5 

-  1.5 

-1075.9 

-  0.1 

-  9.2 

34.4 

-  1.3 

91.3 

-  5.4 

939 

22057.1 

7.2 

1.1 

-  984.6 

-  5.5 

6.9 

41.6 

-0.2 

85.8 

1.5 
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ci 

Xi 

Dli 

°2i 

D3i 

°4i 

yi 

Dli 

°2i 

°3i 

°4i 

940 

22098.7 

7.0 

1.4 

-  898.8 

-  4.0 

-  2.1 

48.6 

1.2 

81.8 

-  0.6 

941 

22147.3 

8.2 

-  2.8 

-  817.0 

-  4.6 

-  2.3 

56.8 

-  1.6 

77.2 

-  2.9 

942 

22204.1 

6.6 

1.8 

-  739.8 

-  7.5 

9.6 

63.4 

0.2 

69.7 

6.7 

943 

22267.5 

6.8 

-  2.1 

-  670.1 

-  0.8 

-18.4 

70.2 

-  1.9 

68.9 

-11.7 

944 

22337.7 

4.9 

3.8 

-  601.2 

-12.5 

21.0 

75.1 

1.9 

56.4 

9.3 

945 

22412.8 

6.8 

-  6.6 

-  544.8 

-  3.2 

-15.4 

81.9 

-  4.9 

53.2 

-  6.1 

946 

22494.7 

2.1 

7.4 

-  491.6 

-  9.3 

8.4 

84.0 

2.  7 

43.9 

2.3 

947 

22578.7 

4.8 

-  5.0 

-  447.7 

-  7.0 

-  4.7 

88.8 

-  2.3 

36.9 

-  2.4 

948 

22667.5 

2.5 

1.7 

-  410.8 

-  9.4 

5.1 

91.3 

-  0.6 

27.5 

2.7 

949 

22758.8 

1.9 

1.1 

-  383.3 

-  6.7 

-13.9 

93.2 

0.5 

20.8 

-11.2 

950 

22852.0 

2.4 

-  4.1 

-  362.5 

-17.9 

24.7 

95.5 

-  3.6 

2.9 

13.5 

951 

22947.6 

-  1.2 

1.0 

-  359.6 

-  4.4 

-23.5 

94.4 

-  2.6 

-  1.5 

-10.0 
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ci 

x  . 

1 

Dil 

°2i 

°3i 

°4i 

yi 

Dli 

°2  i 

D  3i 

°4i 

952 

23042.0 

-  3.8 

5.3 

-  361.1 

-14 . 4 

19.1 

90.6 

2.7 

-15.9 

9.1 

953 

23132.6 

-  1.1 

2.9 

-  377.0 

-  5.3 

2.9 

89.5 

-  0.2 

-21.2 

12.0 

954 

23222.1 

-  1.3 

8.2 

-  398.2 

6  .  7 

-21.6 

88.2 

8.0 

-14.5 

-  9.6 

955 

23310.3 

6.7 

22.  7 

-  412.7 

-  2.9 

12.5 

94.9 

-14.7 

-17.4 

2.9 

956 

23405.2 

-  8.0 

22.7 

-  430.1 

0.0 

-  1.2 

86.9 

8.0 

-17.4 

1.7 

957 

23492.1 

-  0.0 

9.8 

-  447.5 

1 .  7 

2.3 

86.9 

-  1.8 

-15.7 

4.0 

958 

23579.0 

-  1.8 

4.7 

-  463.2 

5  .  7 

-24.0 

85.1 

2.9 

-10.0 

-20.0 

959 

23664.1 

1.1 

0.8 

-  473.2 

-14  .  3 

46.5 

86.2 

3.7 

-24.3 

26.5 

960 

23750.3 

4.8 

-8.1 

-  497.5 

-12.2 

-47.7 

91.0 

-  4.4 

-12.1 

-21.2 

961 

23841.3 

0.4 

3.6 

-  509.6 

9.0 

41.2 

91.4 

-  0.8 

-21.1 

20.0 

962 

23932. 7 

-  0.4 

0.1 

-  530.7 

11.0 

-36.3 

91.0 

-  0.7 

-10.1 

963 

24023.7 

-  1.1 

4.5 

-  540.8 

-5.3 

33.7 

89.9 

3.8 

-15.4 

17.4 
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ci 

Xi 

Dli 

°2i 

°3i 

°41 

yi 

Dli 

°2i 

°3i 

°4i 

964 

24113.6 

2.7 

-  4.0 

-  556.2 

12.1 

-37.4 

92.6 

-  0.2 

-  3.3 

-20.0 

965 

24206.2 

2.5 

-  7.1 

-  559.5 

7.9 

25.0 

95.1 

-  7.3 

-11.2 

5.0 

966 

24301.3 

-  4.8 

15.5 

-  570.7 

-  2.9 

-13.4 

90.3 

8.2 

-14.1 

-  8.4 

967 

24391.6 

3.4 

-15.1 

-  584.8 

-11.3 

23.2 

93.7 

-  6.9 

-25.4 

14.8 

968 

24485.3 

-  3.5 

16.3 

-  610.2 

3.5 

-12.4 

90.2 

9.4 

-21.9 

2.4 

969 

24575.5 

5.9 

-16.7 

-  632.1 

5.9 

-  1.7 

96.1 

-  7.3 

-16.0 

0.7 

970 

24671.6 

-  1.4 

17.0 

-  648.1 

6.6 

-12.  7 

94.7 

9.7 

-  9.4 

-12.0 

971 

24766.3 

8.3 

-38.1 

-  657.5 

-  5.4 

24.5 

103.0 

-28.4 

-14.8 

12.5 

972 

24869.3 

-20.1 

61.0 

-  672.3 

7.1 

-26.2 

82.9 

32.6 

-  7.7 

-13.  7 

973 

24952.2 

12.5 

-44 . 6 

-  680.0 

-  6.6 

22.8 

95.4 

12.0 

-14.3 

9.1 

974 

25947.6 

0.5 

9.9 

-  694.3 

2.5 

-  9.2 

95.9 

-  2.1 

-11.8 

-  0.1 

975 

25143.5 

-1.6 

5.3 

-  706.1 

2.4 

-  0.9 

94.3 

3.2 

-  9.4 

-  1.0 
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ci 

Xi 

Dli 

°2i 

°3i 

°4i 

yi 

Dli 

°2i 

°3i 

°4i 

976 

25237.8 

1.6 

-  4.3 

-  715.3 

1.4 

1.5 

95.9 

-  1.1 

-  8.0 

0.5 

977 

25333.7 

0.5 

-  3.2 

-  723.5 

1.9 

-  4.8 

96.4 

-  4.3 

-  6.1 

-  4.3 

978 

25439.1 

-  3.8 

12.0 

-  729.6 

-  2.4 

9.8 

92.6 

7.7 

-  8.5 

5.5 

979 

25522.7 

3.9 

-12.8 

-  738.1 

3.1 

-10.5 

96.5 

-  5.1 

-  5.4 

-  5.0 

980 

25619.2 

-  1.2 

7.2 

-  743.5 

-  1.9 

8.3 

95.3 

2.1 

-  7.3 

3.3 

981 

25714.5 

0.9 

-  2.8 

-  750.8 

1.4 

-  4.8 

96.2 

-  0.7 

-  5.9 

-  1.5 

982 

25810.7 

0.2 

-  3.6 

-  756.7 

-  0.1 

4.9 

96.4 

-  4.3 

-  6.0 

3.4 

983 

25907.1 

-  4.1 

8.3 

-  762.7 

3.3 

-  6.7 

92.3 

4.1 

-2.7 

-  3.3 

984* 

25999.5 

0.0 

-51.9 

-  765.4 

-  0.0 

-  8.5 

92.4 

-47.9 

-  2.7 

-11.8 

985 

26091.8 

-47.9 

95.8 

-  768.1 

-11.8 

23.6 

44.5 

47.9 

-14.5 

11.8 

986* 

26136.3 

0.0 

-47.9 

-  782.6 

0.0 

-11.  8 

44.5 

0.0 

-14.5 

-  0.0 
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